What an internal chatbot is, and how it differs from the one on your website
An internal chatbot is a chat only your team can get into. It answers with the company's documents: procedures, price lists, terms, policies. The one on your website is something else: it deals with customers, anyone can see it, and it should only say what's public.
The headlines about internal AI chatbots tend to come from very large companies. You don't need that scale. A twenty-person company has the same problem in miniature: the same HR and IT questions, asked again every week, answered by whoever happens to be at their desk.
The word is a bit of a trap. Strictly speaking, a chatbot follows a script written ahead of time. What people look for today as an “internal AI chatbot” is closer to an internal assistant: it understands the question even if nobody planned for it, and it writes the answer from what it finds. Here we use the everyday word.
What documents an internal company chatbot needs to start
Fewer than you think. An internal chatbot starts well with what gets asked the most and what does the most damage when it's answered wrong:
- What you do and for whom. It frames every answer.
- What you sell and on what terms. Prices, lead times, minimums, returns.
- The procedures people look up the most. At Juniper Ridge Supply, a twenty-person HVAC parts distributor split between office and warehouse, those are the employee handbook, the IT policy and the warehouse rules.
- What can't be said. The promises nobody should make to a customer or a vendor.
That set is called a knowledge base. Short and current beats long with three versions of everything.
How to build an internal chatbot for your business, step by step
- Gather. What's already written, without drafting anything new. Plan on an afternoon.
- Upload. In current formats, leaving out what's expired.
- Test with real questions. Write down the twenty you heard most last month and ask them. Don't only check whether it gets them right: watch what it does when it can't.
- Open it to the team. First to three people in different roles, for a week. Then to everyone else, making clear what it's for and that what it writes is a draft.
- Go over what it didn't know. Fifteen minutes a week. Every unanswered question is a missing document.
If the documents exist, the effort is days, not months. If they don't, the job is writing them, and no tool fixes that. What to upload and how to prepare it is in the guide to training AI on your own data.
The key idea: an internal chatbot fails in three ways: it makes things up, it passes off an old fact as current, or it goes quiet. Before you pick a tool, provoke all three.
The three classic mistakes
- Uploading everything unsorted. With the 2023 memo and this year's both in there, it can answer with either.
- Not saying who to ask when it doesn't know. A bare “I don't know” leaves the person where they started. Write down who owns each topic.
- Assigning nobody to maintain it. With no owner, in six months nobody trusts it and people go back to asking down the hall.
When it isn't worth it
If there are four of you at the same table, asking out loud is faster. If almost nothing is written down and nobody is going to write it, it doesn't pay off either. And if what you want is to handle customers from your website, you need a different kind of tool; our comparison with CustomGPT looks at one.