Senior AI Harness EngineerID:61269

16,000 MYR ~ 25,000 MYRBangsarabout 3 hours ago

Overview

  • Salary

    16,000 MYR ~ 25,000 MYR

  • Industry

    IT/Telecommunications

  • Job Description

    1. Continuously monitor and evaluate leading AI vendors, frontier models, and emerging AI technologies, assessing their capabilities, cost, context handling, and agentic performance. Provide clear recommendations on model suitability and adoption.
    2. Develop and implement a vendor diversification and resilience strategy by evaluating alternative AI vendors, model routing solutions, and self-hosted LLM options. Establish reliable fallback and switching mechanisms to reduce dependency on a single vendor.
    3. Build and maintain internal AI evaluation benchmarks based on real-world codebases and business scenarios to objectively measure and compare model performance.
    4. Take ownership of and continuously improve company-wide AI development workflows and best practices, including prompt and context engineering standards, agent configurations, code review and validation processes, and safety guardrails.
    5. Define and enforce AI security and compliance standards to prevent source code and sensitive data leakage, mitigate prompt injection risks, establish security review requirements for AI-generated code, and implement appropriate data masking and access controls.
    6. Build and maintain internal AI harnesses and developer tooling, including shared configurations, skills and plugins, evaluation scripts, and CI integrations, enabling engineering teams to adopt AI tools efficiently.
    7. Document AI development best practices, conduct technical training and knowledge-sharing sessions, and track AI adoption and developer productivity metrics across engineering teams.

Qualifications

  • Requirement

    1. At least 3 years of extensive hands-on experience with agentic coding tools such as Claude Code, Codex, Cursor, or similar tools, with practical knowledge of the strengths and limitations of different frontier AI models.
    2.Strong understanding of prompt engineering, context engineering, and model evaluation methodologies, including benchmark design and evaluation harnesses.
    3.Strong technical curiosity and self-motivation, with the ability to independently follow developments in the rapidly evolving AI ecosystem, conduct evaluations, and translate findings into actionable recommendations.
    4.Good understanding of key LLM and AI application security risks, including data leakage, prompt injection, and supply chain risks associated with AI-generated code, as well as relevant mitigation practices.
    5.Excellent written communication and cross-functional collaboration skills, with the ability to establish and drive engineering standards across multiple teams.
    6.Experience in LLM application development, AI evaluation frameworks, developer productivity, or platform engineering.
    7. Experience with self-hosted LLM deployment, model routing, or AI inference infrastructure.
    8.Open-source contributions, technical blogging, public speaking, or other forms of technical knowledge sharing.

  • English Level

    -

  • Other Language

    Mandarin, English

Additional Information

  • Benefit

    Annual Leave:
    1-2 years = 12 days
    3-4 years = 16 days
    5 years and above = 18 days

    Bonus:
    13th month salary

    Allowances:
    Transport, Meal, Birthday Allowance
    Medical/Dental/Optical claim

    Others:
    - Sports Activities (Badminton & Basketball)
    - Company Outing
    - Training and certification sponsored by company (Selected employees).
    - Rewards and recognition: Long Service Award / Best Performer Award / Role Model Awards etc
    - Project Incentive (upon Company Declaration based on project performance)

  • Working Hour

    09:00 ~ 18:00

  • Holiday

    Follow Malaysia PH

  • Job Function