Senior Software Engineer
Maya Philippines View all jobs
- Metro Manila
- Permanent
- Full-time
- Design and build Agentic AI solutions using existing LLMs and integrate them with Enterprise Applications/Systems where applicable.
- Architect multi-step agent workflows with reliable tool/function calling, memory management, error handling, and graceful degradation
- Build and maintain AI solutions for document processing (IDP), process automation, and internal knowledge management using agentic patterns
- Actively participate in coding tasks, including building and deploying AI/ML models into production environments, and integrating solutions within the current tech stack
- Design and implement evaluation frameworks for LLM outputs, including LLM-as-judge patterns, RAGASstyle retrieval evaluations, regression testing for prompt changes, and output reliability scoring
- Build observability and tracing infrastructure for AI systems: cost monitoring, latency tracking, token usage, failure analysis, and audit trails for BSP compliance
- Establish prompt versioning, testing, and governance practices to ensure reproducibility and auditability of AI system behavior
- Serve as the team's technical authority on LLM behavior, prompt engineering best practices, and agentic system design patterns
- Drive technical improvements within the team, co-mentor developers, and ensure alignment with best practices in AI engineering.
- Translate group-level technical strategies (Agentic AI projects, Enterprise AI MCPs) into actionable implementations across enterprise automation workflows
- Design and maintain Model Context Protocol (MCP) servers and tool schemas that enable reliable AI-toenterprise-system integration
- Promote a Platform-as-a-Service (PaaS) mindset: Building reusable, scalable AI components (prompt templates, evaluation suites, agent blueprints) that the broader Enterprise AI team can leverage
- Conduct technology evaluations for AI tools, frameworks, and models, and recommending the most suitable options with sound cost/performance tradeoffs
- Ensure all AI systems produce auditable decision trails that satisfy BSP regulatory requirements and internal InfoSec/CISO standards
- Implement guardrails, content filtering, and safety mechanisms for production LLM systems handling sensitive financial data
- Education: Bachelor's Degree in Computer Science, Engineering, Information Technology, or related field required. Master's Degree holders in Computer Science, Artificial Intelligence, or related fields preferred.
- Experience: 5+ years in software engineering or AI/ML development, with at least 2 years of hands-on experience building production systems using large language models (LLMs). Demonstrated experience designing agentic AI systems, building LLM evaluation frameworks, and deploying AI services in containerized environments. Experience in regulated industries (banking, finance, insurance) is strongly preferred.
- Technical Skills: Expert-level knowledge of Python and API development. Deep understanding of LLM behavior, prompt engineering, and agentic patterns. Familiarity with evaluation frameworks (RAGAS, LLM-as-judge, custom metrics). Experience with n8n, AWS services, and understanding of Low-Code/No-Code tools is a plus.
- Leadership: Proven ability to serve as a technical authority on AI/LLM systems, guide team members effectively, and contribute directly to development tasks involving agentic AI and enterprise platforms.
- Industry Knowledge: Deep understanding of enterprise AI applications, agentic AI architectures, Model Context Protocol (MCP), and emerging trends in LLM/GenAI-powered automation. Understanding of BSP regulatory requirements and financial services compliance frameworks is a plus.