Auto Orchestrator

The Auto Orchestrator is a Workflow node that automatically chooses the most relevant Knowledge Base for a user’s question.

It is useful when a Workflow has multiple Knowledge Bases and you want the Workflow to determine which one should handle the user’s request.

The Auto Orchestrator compares the connected Knowledge Bases and selects the one with the most relevant answer. If multiple Knowledge Bases are equally relevant, it can ask the user a follow-up question to clarify what they need.

Use Auto Orchestrator when a question could match more than one Knowledge Base. If your Workflow uses only one Knowledge Base, connect Start → Knowledge Base instead.

How Auto Orchestrator Works

The Auto Orchestrator is placed between the previous node and one or more Knowledge Base nodes.

For example:


Start → Auto Orchestrator → Knowledge Base (Billing)
                           → Knowledge Base (Products)
                           → Knowledge Base (Policies)

When a user sends a message, the Auto Orchestrator:

Checks every connected Knowledge Base.
Determines which Knowledge Base has a relevant answer.
Selects the Knowledge Base that is the best match.
If two or more Knowledge Bases are equally relevant, asks the user a follow-up question.
Uses the user’s clarification to help select the appropriate Knowledge Base.

If one Knowledge Base is clearly the best match, no follow-up question is required.

The Auto Orchestrator chooses between connected Knowledge Base paths. The actual document search and answer generation are handled by the connected Knowledge Base nodes.

Add Auto Orchestrator

To add an Auto Orchestrator to your Workflow:

Open the Workflow canvas.
From the node list, find Auto Orchestrator under Core.
Add the node to the canvas.
Connect the previous node, usually Start, to the Auto Orchestrator.
Connect the Auto Orchestrator to one or more Knowledge Base nodes.

For example:


Start → Auto Orchestrator → Knowledge Base

You can connect multiple Knowledge Bases to the Auto Orchestrator.

The Auto Orchestrator supports up to 10 incoming and 10 outgoing connections.

The Auto Orchestrator can connect only to Knowledge Base nodes. It cannot connect directly to Agent, User Feedback, If / Else, or End nodes.

Configure Auto Orchestrator

Select the Auto Orchestrator node to open its configuration panel.

When the node has not been configured, the panel displays Add.

After configuration, the panel displays a summary of the selected settings.

Setting	Description
Provider	Model provider used for follow-up questions
Model	Model used to generate follow-up questions
Temperature	Controls how consistent or varied follow-up questions are
Follow-up format	Shows whether follow-up questions use Guided options or Text response

Select Add to configure the node for the first time, or View / Edit to update an existing configuration.

Auto Orchestrator Settings

Select Add or View / Edit to open the Auto Orchestrator Settings dialog.

The settings control how the Auto Orchestrator generates clarification questions when it cannot determine which Knowledge Base is the correct match.

Provider

The Provider determines which model provider is used to generate follow-up questions.

Select a provider from the available options.

Model

The Model determines which model generates the follow-up clarification question.

The available models depend on the orchestrator credits available to your account. Some models display their credits per run.

The Model field is required. You cannot save the configuration without selecting a model.

A deprecation notice may appear next to a model if that model is scheduled to change.

Temperature

Temperature controls how consistent or varied the generated follow-up question is.

The supported range is 0.0–2.0, with a default value of 0.7.

Lower values produce more consistent follow-up wording.
Higher values produce more varied follow-up wording.

For some GPT-5 models, Temperature is fixed to 1 and cannot be changed.

Show Follow-up as Choices

The Show follow-up as choices option controls how clarification questions are presented to the user.

When disabled, the user can type a response.

When enabled, the user can select from radio-button options.

Setting	Follow-up format	User experience
Off	Text response	User types a reply
On	Guided options	User selects an option

This setting affects only the presentation of clarification questions. It does not change how Knowledge Base documents are retrieved.

Select Save to apply the configuration or Cancel to close the dialog without saving.

Follow-up Questions

The Auto Orchestrator asks a follow-up question when it cannot clearly determine which connected Knowledge Base is the best match.

For example, suppose a Workflow has:

Knowledge Base: Billing
Knowledge Base: Products
Knowledge Base: Policies

If a user asks a question that clearly relates to Billing, the Auto Orchestrator can select the Billing Knowledge Base without asking anything else.

If the question is equally relevant to Billing and Products, the Auto Orchestrator can ask the user for clarification.

The follow-up question is generated using the configured Provider, Model, and Temperature.

Show follow-up as choices determines whether the user types an answer or selects from available options.

Connect Knowledge Bases

A typical setup looks like this:


                    → Knowledge Base (Billing)
                   /
Start → Auto Orchestrator → Knowledge Base (Products)
                   \
                    → Knowledge Base (Policies)

The Auto Orchestrator compares the connected Knowledge Bases and selects the appropriate path.

The Workflow still executes one path at a time. It does not run unrelated Workflow paths in parallel.

Auto Orchestrator and Knowledge Base

The Auto Orchestrator and Knowledge Base nodes have different responsibilities.

Node	Responsibility
Auto Orchestrator	Chooses which connected Knowledge Base is the best match
Knowledge Base	Searches the selected Knowledge Base and provides the answer

The Knowledge Base node still contains its own Knowledge Base configuration and options, including Continue only if no answer is found.

Auto Orchestrator does not replace the Knowledge Base node. It decides which connected Knowledge Base path should be used.

When to Use Auto Orchestrator

Multiple Knowledge Bases

Use:


Start → Auto Orchestrator → Knowledge Base A
                           → Knowledge Base B
                           → Knowledge Base C

This allows the Workflow to select the most relevant Knowledge Base automatically.

Single Knowledge Base

If your Workflow has only one Knowledge Base, Auto Orchestrator is not required.

Use:


Start → Knowledge Base

Agent-Based Workflows

If your Workflow requires prompts, tools, memory, structured output, or Chat Canvas, use an Agent instead.

An Agent can optionally use Knowledge Base Retrieval as a tool.

Credits

The selected model displays its credits per run in the Auto Orchestrator Settings dialog.

These credits apply to the Auto Orchestrator step, including follow-up question generation.

The connected Knowledge Base nodes have their own credit usage when they run.

What Auto Orchestrator Does Not Do

Auto Orchestrator does not:

Search a Knowledge Base by itself.
Replace the Knowledge Base node.
Replace an Agent.
Connect directly to Agent, User Feedback, If / Else, or End.
Generate the final answer when a Knowledge Base already provides a clear answer.
Run multiple unrelated Workflow paths at the same time.

Auto Orchestrator at a Glance

Option	Purpose
Auto Orchestrator	Selects the most relevant connected Knowledge Base
Provider	Provider used to generate follow-up questions
Model	Model used to generate follow-up questions
Temperature	Controls how consistent or varied follow-up wording is
Show follow-up as choices	Shows clarification as Guided options or a Text response
Connected Knowledge Bases	Knowledge Bases evaluated for the user’s question

Auto Orchestrator is most useful when your Workflow contains multiple Knowledge Bases and the correct Knowledge Base depends on what the user is asking.