RAZER (ASIA-PACIFIC) PTE. LTD.
See if you qualify before applying
Get your match score and detailed fit analysis in 10 seconds.
We are seeking a Senior Automation Engineer to lead the development and automation of internal AI product testing at the early stages of development. This role is crucial in ensuring that AI models and systems undergo comprehensive validation, development and functional testing, before being integrated into production. You will be responsible for building and maintaining automated testing frameworks that enable AI teams to efficiently test their models and products. As a senior member, you will mentor junior engineers, work cross-functionally with AI teams, and establish robust AI product testing frameworks.
Essential Duties and Responsibilities
Design and implement automated testing frameworks and workflows for AI products / models in early-stage development, both locally and on cloud platforms (AWS, GCP, Azure)
Develop unit tests, integration tests, and functional tests for AI components.
Define best practices for AI product / model testing, debugging, and validation.
Create tools to automate AI product / model evaluation, robustness checks, and explainability testing.
Work with AI teams and data scientists to define benchmarking criteria and pass/fail thresholds.
Build continuous integration and deployment (CI/CD) pipelines to streamline AI product / model testing, in containeriszed environments (Docker, Kubernetes)
Implement version control, rollback mechanisms, and experiment tracking for AI models.
Develop internal tools and dashboards for AI teams to track test results and model performance.
Optimize AI testing environments for parallel and distributed testing at scale.
Partner with AI teams and MLOps teams to enhance internal testing capabilities.
Provide mentorship and technical leadership to junior engineers.
Qualifications
6+ years of experience in AI automation, MLOps, or software testing for AI products.
Proven experience in developing AI testing frameworks and automated validation pipelines, such as AI model evaluation, adversarial testing, and explainability frameworks
Strong programming skills in Python, Bash or Java.
Hands-on experience AI Testing & Validation (Pytest, Great Expectations and etc).
In depth understanding of containerization (Docker, Kubernetes) and DevOps practices.
Experience in developing and deploying AI applications running both edge deployment (TensorRT, ONNX) and on cloud infrastructure (AWS, Azure or Google Cloud Platform) using Infrastructure as code tools such as Terraform
Knowledge of distributed computing (Spark, Dask) and parallel processing.
Strong problem-solving and debugging abilities for AI systems.
Ability and willingness to learn any new technologies and apply them at work in order to stay ahead, in a fast paced, high pressure, agile environment
Excellent written and verbal communication skills for coordinating across teams.
Education & Experience
Has a Bachelor’s or Master’s degree in computer science, AI or similar discipline from an accredited institution
Travel Requirements
Role based in Singapore office and may require up to 1 travel trip per year.