Custom LLM

Last Updated May 17, 2026

Brief Overview

By default, WalkMe's AI features run on WalkMe-managed large language models (LLMs), currently powered by Azure OpenAI. This is the recommended setup for most organizations: it is fully optimized for WalkMe AI out-of-the-box, validated for performance, and requires no additional configuration.

If your organization has a strict internal compliance requirement to use a specific, approved LLM, you may be eligible for Custom LLM (previously referred to as BYOLLM). This is an exception, not the default, and is relevant only in specific, rare cases.

Is Custom LLM right for you?

Custom LLM is a custom configuration option, not a standard product SKU. It is designed for organizations with a mandatory internal requirement to work with a specific, pre-approved LLM.

It is worth noting that WalkMe does not train models on your data, and all processing uses secure protocols. If your concern is primarily around data privacy or residency, reviewing WalkMe's security and data handling documentation is a good first step, as WalkMe's managed LLM may already address those requirements.

If after reviewing the documentation your organization still has a compliance-driven need to use your own LLM, contact your Customer Success Manager to discuss whether Custom LLM is applicable to your situation.

How It Works

Custom LLM uses a hybrid deployment model. In this setup, queries are routed to your LLM, which runs within your own environment. For AI Answers queries, the WalkMe crawler stores content within your environment and pulls from it before submitting queries to your LLM.

Monitoring usage

Once Custom LLM is configured, you can monitor your AI consumption through the AI Usage Dashboard. The dashboard gives you visibility into how WalkMe's AI features are being used across your account, including query volume and usage trends.

This is especially useful when running a Custom LLM configuration, as it helps you track consumption against your own model's capacity and costs.

For full details on the dashboard:

AI Usage Dashboard (Custom LLM)

Default vs. Custom LLM

WalkMe Managed LLM (Default) Custom LLM
Setup Ready out of the box Requires coordination with WalkMe's product team
Optimization Fully optimized for WalkMe AI Depends on your model; not guaranteed
Supported models GPT-4o, selected GPT-5 models Azure AI interfaces and models
Data privacy Secure processing; WalkMe does not train on your data Handled by your LLM provider's policies
Who it's for Most organizations Organizations with a mandatory compliance requirement to use a specific LLM
Risk Low Latency, timeouts, and degraded experience if the model is not validated

Technical Notes

  • Supported provider: Azure AI only. Other LLM providers are not currently supported
  • Deployment model: Hybrid only. Queries are routed through WalkMe's AI Manager to your LLM running within your environment
  • Not self-serve: Enabling Custom LLM requires coordination with WalkMe's product team and is treated as a custom configuration
  • ARM Template required: Configuring the endpoint connection between your LLM and WalkMe requires an ARM Template Deployment Guide, provided by your WalkMe contact
  • Rate limits still apply: WalkMe's AI Manager continues to manage rate limiting and usage caps even when a Custom LLM is in use
  • Model validation: WalkMe benchmarks supported models for latency, reliability, and real-time workflow performance. Models not validated by WalkMe may produce unstable results

Was this article helpful?

Thanks for your feedback!

Be part of something bigger.

Engage with peers, ask questions, share ideas

Ask the Community
×