Set up, test, deploy and manage an AgentFlow AI agent

Learn how to configure your AI agent, validate its responses, and deploy it in AgentFlow

Written By Frieda Yip (Super Administrator)

Updated at March 27th, 2026

Note:

This version of the AgentFlow setup is currently in limited release. If you’re interested in trying it, please contact our team to request early access.

 

 

AgentFlow provides a guided setup experience that helps you create, configure, test, and deploy an AI agent without manually building the logic in Flow Builder.

The setup process uses a 3-step wizard that walks you through creating the agent, configuring its knowledge and behavior, testing responses, and deploying it to your selected channels.

This workflow helps teams:

  • Set up AI agents faster using use-case templates
  • Test responses before going live
  • Understand how the agent generates answers through built-in debugging tools

Typical use cases include:

  • Commerce: product advisor or sales assistant
  • Service booking: answering enquiries and guiding customers to complete bookings
  • Education: helping users explore programs or services

The setup process includes the following steps:

  1. Create the AI agent
  2. Configure the agent and test responses
  3. Deploy the agent to channels

 

Accessing the “Create AI agent” page

You can follow the steps below to access the “Create AI agent” page:

  1. Click the icon on the left-sided panel to go to the SleekFlow AI page
  2. Click on “AgentFlow” in the top navigation bar

 

Step 1: Create the AI agent

There are 2 ways to create your AI agent

  1. If this is the first time you create an AI agent, click “Start now” to get started
  2. If you have already created AI agents, click Create new agent in the top right corner of the page.

The “Create” step allows you to choose a template and define basic information for your AI agent.

 

Choose a template

Start by selecting a template that matches your intended use case.

Available options include templates designed for common scenarios such as:

  • e-Commerce
  • Service booking
  • Education
  • Legal intake agent

Templates provide a structured starting point with predefined Playbook instructions that you can modify later. You can also choose “Custom” and set up your AI agent from scratch.

 

Note:

Selecting a template does not save any configuration yet. Your agent is only created after you proceed to the next step.

 

 

Name your agent

Next, provide the basic details for the agent.

 

Required field:

  • Agent name: Used internally to identify the agent. This name is not visible to customers.

Optional field:

  • Description: A short internal description to help your team understand the agent’s purpose.

 If you have selected a template to start with, these fields will be prefilled. You can edit them to make sure the AI agent name and description is easy for internal team members to recognize.

Click “Create” at the top right corner of the page to continue.

 

Step 2: Configure and test your AI agent

In this step, you define how your AI agent behaves and provide the information it uses to answer customer enquiries.

You will:

  • Add knowledge sources
  • Configure response behavior (only ready in Sprint 78)
  • Define conversation instructions in the Playbook
  • Enable lead scoring (optional)
  • Test the agent using the Testing Playground

The Testing Playground allows you to simulate conversations and evaluate responses before deploying the agent.

 

Add data sources to Knowledge base

Knowledge sources provide the information the AI agent uses to generate responses.You must add at least one knowledge source before testing the agent.

Tip:

If the knowledge source exceeds the available character limit, training may be temporarily disabled until the content size is reduced.

 

 

Available knowledge sources include:

 

Files upload

Files upload allows you to add document-based knowledge for your AI agent.

When you upload files, the system extracts the text content and uses it as reference material when the agent answers customer questions.

You can upload documents in these formats:

  • .PDF
  • .DOCX
  • .XLSX
  • .CSV
  • .JPG

Limits:

  • Up to 20 files
  • Maximum 50 MB per file

These files are indexed and used as reference material when the agent answers customer questions.

You can follow the steps below to upload files as knowledge sources:

  1. In the “Configure” step, click “File” under the “Knowledge” section
  2. A side panel will appear
  3. You can drag and drop the files, or click “upload .DOCX, .PDF, .XLSX, .JPG” and select the files from your device
  4. After selecting the files, the system will start processing the uploaded files. Once it’s done, you will find a list of uploaded files
  5. Once it has completed scanning, you can:
    1. Train selected files: Select the necessary files and add them to the AI agent’s knowledge base as training materials
    2. Delete selected files: Delete the selected files from the list

After the scan is complete and you have selected the files as training materials,, click “Train selected” to process the content.

Note:

Only text content in the uploaded files is extracted for training. Images, layout, and other non-text elements are not used unless the text is embedded in a readable format.

 

 

URL indexing

You can provide a website URL for the system to scan and index.

URL indexing allows the AI agent to retrieve information directly from your website.

When you add a URL, the system scans the webpage and extracts the text content. The AI agent can then reference this information when answering customer questions.

When to use URL indexing

URL indexing works best when your website already contains structured information that customers frequently ask about, such as:

  • Product details or catalog pages
  • FAQ or help center articles
  • Service descriptions
  • Pricing information
  • Policy pages (shipping, returns, etc.)

 

Using URL indexing allows you to train the AI agent on selected website content in advance. This helps the agent respond with better accuracy and faster response times, since it does not need to retrieve information from the website in real time.

Follow the steps below to add URLs for URL indexing:

  1. In the “Configure” step, click “URL indexing” under the “Knowledge” section
  2. A side panel will appear
  3. Enter the URL you would like the AI agent to index
    1. You can enable Scan all subpages under this URL if you want the system to include subpages automatically
  4. Click “Scan URL”
  5. The system will scan the URL and retrieve data if you have selected to scan all subpages under the URL
  6. Once scanning is complete, the detected URLs will appear in the list. 

    At this stage, the website content has only been scanned and added to the SleekFlow platform. It has not been added to the AI agent’s knowledge yet. You can then:

    1. Train selected: Add the selected URLs to the AI agent’s knowledge base as training materials
    2. Delete selected: Remove the selected URLs from the list

 

Important:

The AI agent can only use the website content after you click Train selected. If you do not train the selected URLs, the information will not be ingested by the agent and will not be used in its responses.

 

 

After selecting the URLs you want to use, click Train selected to process the content.

 

Web search

Web search allows your AI agent to retrieve information from specified websites in real time.

Instead of relying only on uploaded or indexed content, the agent can use web search to look up information from the domains or URLs you allow when answering customer questions.

When to use web search

Web search works best when the information you want the AI agent to reference may change frequently and needs to stay up to date.

This is useful for content such as:

  • Product or service pages that are updated regularly
  • Website content that changes often
  • Public information that the agent needs to reference in real time

Use this option when you want the AI agent to search for the latest information from approved websites instead of relying only on pre-trained knowledge sources.

 

Add websites for web search

Note:

When you add a URL or domain for web search, the AI agent can reference content across that entire website. You cannot include or exclude specific pages within the entered URL.

 

You can follow the steps below to add websites for web search:

  1. In the “Configure” step, click “Web search” under the “Knowledge” section.
  2. A side panel will appear.
  3. Enter the domain or URL that you want to allow the AI agent to search.
  4. Click “Add”

 

After the URL is added, it appears in the website list under “Web search”.

From this list, you can:

  • Review the websites added for web search
  • Select one or more websites
  • Delete selected websites if they are no longer needed

 

How web search is used

Web search does not train website content into the AI agent’s knowledge base. Instead, the agent analyzes site content and retrieves information from the added domain in real time during conversations.

Because the content is fetched in real time, response times may be slower compared with pre-indexed content.

 

 

Custom answers

Custom answers allow you to create predefined responses for common customer questions.

Instead of relying on uploaded documents or indexed websites, you can directly define how the AI agent should respond to specific questions. When a customer asks a similar question, the AI agent can return the predefined answer.

Custom answers are organized into sets of related questions that share a single answer.

When to use custom answers

Custom answers work best for short, clear information that should always return a consistent response, such as:

  • Operating hours
  • Store locations
  • Contact information
  • Basic policies
  • Frequently asked questions

You can add multiple training questions that map to the same answer, allowing the AI agent to recognize different ways customers may ask the same question.

Add a custom answer

You can follow the steps below to create a custom answer:

  1. In the “Configure” step, click “Custom answers” under the “Knowledge” section.
  2. A side panel will appear.
  3. Enter the following information:
    1. Set name: Enter a name to identify the group of related questions. For example: Operating hours.
    2. Training question: Enter a question that customers may ask. You can click “Add training question” to include additional variations of the question.
    3. Custom answers: Enter the response that the AI agent should return when a customer asks a related question.
  4. Click “Add” to save the custom answer set.

Once added, the custom answer set will appear in the list.

 

Manage custom answers

After creating custom answers, you can manage them from the list.

You can:

  • View existing custom answer sets
  • Select one or multiple sets
  • Delete selected sets if they are no longer needed

Each set displays the number of training questions associated with it.

 

Global knowledge base

You can also import content from your organization’s Global knowledge base.

This allows multiple agents to reuse the same knowledge sources. Learn more about SleekFlow AI Global knowledge base in this Help Center article.

 

Set response priority

Response priority controls how the agent balances response speed and answer quality.

You can choose from three options:

  • Ultra fast: prioritizes speed for quick responses
  • Balanced: balances response speed and accuracy
  • High quality: prioritizes more detailed and accurate responses

 

Write the Playbook

The Playbook defines how the AI agent should conduct conversations with customers.

 

Use the Playbook editor to write instructions that guide how the agent responds in different scenarios and what actions it can take during a conversation.

When writing the Playbook, you may want to include instructions such as:

  • Tone and communication style: Define how the agent should communicate with customers (for example: friendly, professional, concise).
  • General instructions: Describe the overall role of the AI agent and how it should assist customers.
  • What the agent should avoid: Define any restrictions, such as avoiding speculation, not providing unsupported information, or escalating certain requests.
  • Scenario handling: Provide instructions for how the agent should respond in specific situations, such as refund requests, product inquiries, or booking questions. This can also include what information the agent should collect in each scenario, such as order numbers, product preferences, or booking details.

 

If you selected a template in Step 1, the Playbook will already include predefined instructions that you can review and modify.

 

Using Playbook commands

The Playbook editor supports slash (/) commands, which allow you to insert structured actions directly into the conversation flow.

These commands allow the AI agent to perform actions such as:

  • Applying labels

 

To insert a command:

  1. Type / in the Playbook editor.
  2. Select the action you want to insert from the command list.

 

Note:

The Playbook must contain a minimum amount of content before the AI agent can be tested.

 

 

The Playbook defines how the AI agent should conduct conversations with customers.

 

Calculate lead score (optional)

You can enable “Calculate lead score” to evaluate customer intent during conversations.

When enabled, the agent assigns a score based on the criteria you define.

 

To configure lead scoring:

  1. Toggle Calculate lead score ON
  2. Click on the icon to configure scoring rules
  3. A side panel will appear
  4. In the side panel, the fields in the side panel are pre-filled with suggested criteria. You can edit the criteria and adjust the weights based on your business needs. You can define scoring criteria using the following fields:
    1. Lead score weight (%): Enter the weight for each criterion. The weight determines how much the criterion contributes to the final lead score.
    2. Criteria: Describe the signals the AI agent should evaluate when assigning a score. For example, whether the lead is asking about product features, comparing options, or showing signs of purchase intent.
    3. You can also click “Add criteria” to include additional scoring conditions.

 

Note:

The total weight across all criteria must add up to 100% before you can save the configuration.

 

 

If you wish to revert back to the pre-filled content, click “Use default” at the top right corner.

After configuring the criteria, click “Save” at the top right corner to apply the lead scoring rules.

Once enabled, the AI agent will automatically calculate lead scores during conversations based on the defined criteria. Lead scoring helps your team identify high-potential leads and prioritize follow-up actions.

 

Test your agent in the Testing Playground

The Testing Playground allows you to test your AI agent and review how responses are generated before deployment.

The testing panel appears on the right side of the setup page.

Testing becomes available after:

  • You have added at least one knowledge source
  • You have configured the Playbook

If your knowledge sources are still indexing, chat testing may still be available. However, the agent’s responses may change after indexing is complete.

 

Test responses via chat

Once you have added at least 1 knowledge source and have configured the Playbook, you can use the chat testing interface to simulate conversations with the AI agent.

 

To test responses:

  1. Click “Test responses via chat.”
  2. Use the suggested conversation starters, or enter your own message.
  3. In the chat testing view, you can see the following:
    1. AI agent response 
      1. The main response card shows how the AI agent would answer the customer’s message.
      2. This allows you to check whether the response is accurate, clear, and aligned with the behavior defined in the Playbook.
    2. Actions taken
      1. The Actions taken section shows the steps the AI agent performed before generating the response.
      2. This may include actions such as:
        1. Searching the knowledge base
        2. Calling an integration or API
        3. Calculating lead score, if enabled
      3. This section helps you understand how the AI agent arrived at its answer.
    3. Sources
      1. The Sources section shows the knowledge sources referenced in the response.
      2. For each source, you can see the file name and a short text snippet used by the AI agent. This helps you verify whether the response is grounded in the correct source material.
    4. Response feedback
      1. Below the response, you can indicate whether the generated reply matches your expectation.
      2. Use this to quickly review whether the response quality is acceptable during testing.
    5. Suggested follow-up questions
      1. The chat panel may also display suggested follow-up questions based on the conversation.
      2. You can click these suggestions to continue testing how the AI agent responds to related customer questions.
    6. Message input field
      1. At the bottom of the panel, you can enter additional messages to continue the conversation and test different scenarios.
      2. This allows you to simulate multi-turn conversations and evaluate how the AI agent responds across the full interaction.

 

Run response batch test

Response batch test allows you to evaluate how confidently the AI agent answers a set of auto-generated test questions based on your knowledge sources.

Instead of testing one message at a time, batch testing creates multiple questions from your uploaded knowledge and runs them through the AI agent. This helps you quickly identify what the agent answers well and which areas may need improvement before deployment.

To run a response batch test:

  1. Click “Run response batch test” in the Test playground
  2. Select the testing language.
  3. Click “Run performance test”.
  4. After the test is complete, you can review the results in the following ways:
    1. Overall confidence score
      1. At the top of the results page, you can see the overall confidence score for the batch test. 
      2. This summary shows how well the AI agent performed across all generated questions, including the number of responses that fall into each confidence category.
    2. Confidence categories
      1. The test results are grouped into confidence categories, such as:
        1. Excellent
        2. Needs attention
      2. This helps you quickly identify which answers are performing well and which ones may need improvement.
    3. Individual test results
      1. Each test result shows:
        1. The generated test question
        2. The AI agent’s answer
        3. The confidence score for that answer
        4. The knowledge source used to generate the question
      2. This allows you to review how the AI agent responded to each question and whether the answer is supported by the expected source material.

Once you have completed the configuration and testing your AI agent, click “Save” at the top right corner to go to Step 3.

 

Step 3: Deploy your AI agent

After configuring and testing your AI agent, you can deploy it so it begins responding to customer conversations.

In this step, you will:

  1. Select the channel where the AI agent should respond
  2. Optionally define when the agent is allowed to reply
  3. Configure exit conditions that determine when the agent stops responding. In this step, you can also add follow-up action on how you would like the conversation to be handled after the AI agent exits the conversation.

 

Select channel

First, choose the channel where the AI agent will receive and respond to messages.

To configure this:

  1. In the Deploy step, locate the Channel section.
  2. Select the channel from the dropdown list.
  3. This defines the channel where the AI agent will handle incoming messages.

 

Note:

You must select at least one channel before deploying the AI agent.

 

 

Set specific reply time (optional)

You can control when the AI agent is allowed to reply to customers by enabling Set specific reply time.



 

To configure reply time:

  1. Toggle Set specific reply time ON.
  2. Select the days of the week when the AI agent should be active.
  3. Set the From and To time.

 

This allows you to control when the AI agent is allowed to respond. For example, you may choose to activate the AI agent only outside of business hours.

The system supports overnight reply windows, such as 6:00 PM to 9:00 AM.

 

Set exit conditions

The “When to exit” section allows you to define conditions that determine when the AI agent should stop responding in a conversation.

 

By default, the AI agent includes predefined exit conditions for common conversation scenarios. These conditions determine when the AI agent should stop responding in a conversation.

The default exit conditions include:

  • Confidence is low: when the AI agent’s response confidence is low
  • Time out: when the conversation becomes inactive for a period of time
  • Human agent takes over: when a human agent joins the conversation
  • System error: when the AI agent encounters a system error

You can review and edit these default exit conditions based on your business needs.

 

To configure an exit condition:

  1. Locate the “When to exit” section.
  2. Click open the exit condition
  3. Define the trigger criteria.
  4. Optionally add a follow-up action after the AI agent exits. Follow-up actions define what happens next after the AI agent stops responding. In the deployment page, you can configure a limited set of follow-up actions, such as:
    1. Assign the conversation to a team member
    2. Add labels to the conversation for tracking or categorization
    3. If you need more advanced exit logic or additional actions, you can continue editing the generated flow later in Flow Builder.
  5. You can click “Add exit condition” to configure additional exit rules.

 

These conditions help ensure that conversations are appropriately handed over or ended when the AI agent is no longer able to assist effectively.

 

Deploy the AI agent

Once the channel and optional settings are configured:

  1. Click “Save” and deploy in the top right corner.

After deployment:

  • The AI agent becomes active
  • The agent will start responding to conversations on the selected channel
  • You will be redirected back to the AI agent list
  • The system automatically creates a corresponding flow in Flow Builder

The generated flow can be used for more advanced configuration, such as refining exit logic or adding additional actions beyond what is available in the deployment page.

 

You can return later to update the agent configuration or adjust the deployment settings if needed.

 

Manage an existing AI agent

Prerequisite:

Your AI agent must be active in AgentFlow before you can manage or update it.

 

On the AgentFlow list page, an active agent:

  • Shows Edit as the primary action
  • Displays “Active flows in use: X flows on the agent card”

 

 

 

After creating and deploying an AI agent, you can return at any time to update its configuration, re-test responses, or adjust deployment settings.

To manage an existing AI agent:

  1. Click on the icon on the left navigation bar to go to SleekFlow AI page
  2. Under the “AgentFlow” tab, locate the agent you want to manage
  3. Within the card, you can:
    1. Edit the AI agent by clicking on the “Edit” button
    2. Delete the AI agent by clicking on the icon

 

Update configuration and testing

In the “Configure” step, you can:

  • Add, remove, or retrain knowledge sources
  • Update the Playbook instructions
  • Adjust response priority and behavior settings
  • Update lead scoring settings, if enabled
  • Run chat testing and response batch tests again before saving changes

 

Manage exit conditions

In the “Exit” tab, you can manage the AI agent’s global exit conditions and follow-up actions.

You can:

  • Add a new exit condition
  • Edit an existing exit condition
  • Delete an existing exit condition. Please note that when you delete an exit condition, it is removed from all of the existing  flows.
  • Update follow-up actions linked to exit handling

 

Important: 

If you add a new exit condition, you must confirm whether to redeploy the AI agent:

  • Save and pause flows
  • Save and publish flows
 

 

Other updates, such as editing or deleting existing exit conditions, apply without redeployment.

 

Update deployment settings

In the “Deploy” step, you can:

  • Change the connected channel
  • Update the reply schedule
  • Review and edit exit conditions
  • Adjust follow-up actions available in the deployment setup

After making changes, click Save and deploy to apply the updates.

In the Deploy tab, you can view the AI agent’s current deployments and create or update flows based on the deployment type.

 

Create a new flow

To deploy the AI agent to an additional flow, create a new flow in the Deploy tab and complete the deployment setup.

Depending on the deployment type, you can configure settings such as:

  • Connected channel
  • Reply schedule

After setting up the flow, click Save and deploy to apply the deployment.

 

Update an existing flow

For an existing deployment that is not managed in Flow Builder, you can:

  • Change the connected channel
  • Update the reply schedule

After making changes, click “Save and deploy” to apply the updates.

 

Flow Builder-managed deployment

For deployments managed in Flow Builder, deployment settings cannot be edited directly in AgentFlow.

 

 

Fields that cannot be edited

The following fields can only be set when the AI agent is first created:

  • Agent name
  • Description

If you need to use a different agent name or description, create a new AI agent instead.