Job description

About the Role

As our AI Engineer, you will take ownership of the AI layer of our product, ensuring the quality, reliability, performance, and continuous improvement of its AI capabilities.

You will be involved throughout the development lifecycle, from defining technical solutions and designing architectures to implementing, evaluating, deploying, and optimising AI systems.

We are looking for someone who can work independently, make sound technical decisions, and deliver production-ready AI solutions with minimal supervision.

Key Responsibilities

• Design and Develop AI Solutions: Translate business requirements into practical AI architectures, determining when to use conventional software, retrieval systems, or AI agents.
• Build and Deploy AI Capabilities: Collaborate with product and engineering teams to develop, test, deploy, and maintain production-ready AI solutions.
• Optimise AI Performance: Improve answer quality, retrieval accuracy, response latency, reliability, and operational costs.
• Implement AI Evaluations: Establish testing frameworks, performance metrics, and monitoring systems to measure AI quality and identify potential failures.
• Ensure AI Reliability and Security: Implement appropriate guardrails, access controls, privacy protections, and reliable execution processes.
• Continuously Improve Systems: Analyse production issues, identify root causes, and implement improvements to AI architecture and operating practices.

Required Technical Skills and Experience

We are looking for candidates with strong practical experience in the following areas:

1. AI Engineering and Architecture

• Strong proficiency in Python and asynchronous services.
• Experience developing AI agents, workflows, tool calling, MCP, structured outputs, state, and memory.
• Solid understanding of Retrieval-Augmented Generation (RAG), embeddings, retrieval, reranking, and source grounding.

2. AWS AI Technologies

• Hands-on experience with Amazon Bedrock and AgentCore.
• Familiarity with AgentCore Runtime, Gateway, Memory, Identity, and Observability.
• Experience with Strands Agents or comparable AI orchestration frameworks.

3. AI Evaluation and Monitoring

• Experience developing evaluation datasets, regression tests, and adversarial tests.
• Understanding of task-success metrics, retrieval performance, and AI response quality.
• Ability to monitor production behaviour, analyse system traces, and identify performance issues.

4. AI Security and Reliability

• Knowledge of prompt-injection prevention, access controls, tenant isolation, and data privacy.
• Experience implementing retries, fallbacks, idempotency, and controlled tool execution.
• Understanding of model versioning, prompt versioning, and quality-based release processes.

5. AI-Assisted Development

• Strong practical experience using Claude Code and OpenAI Codex.
• Ability to manage AI coding agents through clear instructions, context management, and scoped tasks.
• Capable of reviewing, testing, and validating AI-generated code.

Additional Advantage:
Experience working with local or open-weight AI models, model serving, quantisation, hardware constraints, and self-hosted inference.

What We Expect From You

At Ai32, technical expertise must be matched by three essential personal qualities:

• Integrity: You communicate honestly about results, progress, estimates, and mistakes. You take responsibility for your work and never misrepresent what a system can do.
• Independence: You can work autonomously, make informed technical decisions, and deliver outcomes without requiring constant supervision.
• Initiative: You proactively identify problems, risks, and opportunities for improvement rather than waiting for instructions.

We value professionals who are accountable, resourceful, proactive, and committed to delivering high-quality work.

Working Arrangements

• Fully remote position for candidates residing in Pakistan, the Philippines, Indonesia, Ukraine, Poland, Romania, or Belarus.
• Full-time contract engagement.
• Flexible day-to-day working schedule, with some overlap required with our Perth, Australia (AWST) working hours.
• Performance and deliverables are prioritised over strict minute-by-minute monitoring.
• Opportunity to work directly on real-world AI products and systems.
• Competitive, top-of-market remuneration for exceptional candidates.

What Success Looks Like

Within your first 12 months, you will be expected to:

• Take ownership of the Core32 AI layer in production, with established evaluations, monitoring, and performance metrics.
• Demonstrably improve AI response quality while reducing latency and operational costs.
• Make sound architectural decisions regarding AI retrieval and agent systems.
• Proactively identify and resolve technical issues before they affect clients or end users.
• Contribute to improving the overall AI engineering standards of the team.

This Position May Not Be For You If:

• You prioritise choosing AI models or frameworks over understanding the actual business problem.
• You deploy AI solutions without proper testing and evaluation.
• You rely on demonstrations rather than measurable production performance.
• You accept AI-generated code without understanding or validating its functionality.
• You require constant supervision to complete assigned responsibilities.

Our Recruitment Process

We follow a structured recruitment process designed to assess both technical expertise and professional suitability.

1. Initial Conversation: A brief, semi-formal discussion to understand your background, experience, and mutual expectations.
2. Technical Interview: An in-depth discussion of AI systems you have designed, developed, deployed, or improved.
3. Practical Demonstration: A live walkthrough of a previously delivered AI product, including its architecture, evaluations, system traces, and your AI-assisted coding workflow.
4. Final Interview and Background Checks: A closing discussion followed by reference and background verification.

How to Apply

Interested candidates based in Pakistan, the Philippines, Indonesia, Ukraine, Poland, Romania, or Belarus are encouraged to apply.

We are particularly interested in engineers who can demonstrate real-world experience building, deploying, and maintaining production-ready AI systems.

When applying, please be prepared to showcase:

• An AI product or system you have successfully developed and deployed.
• Its architecture, evaluation methods, and monitoring approach.
• A technical challenge or system failure you identified and resolved.
• Your approach to balancing AI quality, performance, and operational costs.
• Your practical workflow using AI coding tools such as Claude Code or Codex.

Join Ai32 and help us build AI systems that deliver meaningful, measurable results.