IBM estimates that 265 billion customer support tickets and calls are made globally every year, resulting in $1.3 trillion in customer service costs. IBM also referenced a Chatbots Magazine figure purporting that implementing customer service AI solutions, such as chatbots, into service workflows can reduce a business’ spend on customer service by 30 percent.
This reference architecture describes how to build an enterprise-grade conversational bot (chatbot) using the Azure Bot Framework. Each bot is different, but there are some common patterns, workflows, and technologies to be aware of. Especially for a bot to serve enterprise workloads, there are many design considerations beyond just the core functionality. This article covers the most essential design aspects, and introduces the tools needed to build a robust, secure, and actively learning bot.
In 2000 a chatbot built using this approach was in the news for passing the “Turing test”, built by John Denning and colleagues. It was built to emulate the replies of a 13 year old boy from Ukraine (broken English and all). I met with John in 2015 and he made no false pretenses about the internal workings of this automaton. It may have been “brute force” but it proved a point: parts of a conversation can be made to appear “natural” using a sufficiently large definition of patterns. It proved Alan Turing’s assertion, that this question of a machine fooling humans was “meaningless”.

When one dialog invokes another, the Bot Builder adds the new dialog to the top of the dialog stack. The dialog that is on top of the stack is in control of the conversation. Every new message sent by the user will be subject to processing by that dialog until it either closes or redirects to another dialog. When a dialog closes, it's removed from the stack, and the previous dialog in the stack assumes control of the conversation.

Your first question is how much of it does she want? 1 litre? 500ml? 200? She tells you she wants a 1 litre Tropicana 100% Orange Juice. Now you know that regular Tropicana is easily available, but 100% is hard to come by, so you call up a few stores beforehand to see where it’s available. You find one store that’s pretty close by, so you go back to your mother and tell her you found what she wanted. It’s $2, maybe $3, and after asking her for the money, you go on your way.
2010 SIRI: Though Siri is considered colloquially to be a virtual assistant rather than a conversational bot, it was built off the same technologies and paved the way for all later AI bots and PAs. Siri is an intelligent personal assistant with a natural language UI to respond to questions and perform web-based service requests. Siri was part of apples IOS.

These are just a few of the most inspirational chatbot startups from the last year, with numerous others around the globe currently receiving acclaim for how quickly and innovatively they are using AI to change the world. With development becoming more intuitive and accessible to people all over the world, we can expect to see more startups using new technology to solve old problems.


This machine learning algorithm, known as neural networks, consists of different layers for analyzing and learning data. Inspired by the human brain, each layer is consists of its own artificial neurons that are interconnected and responsive to one another. Each connection is weighted by previous learning patterns or events and with each input of data, more "learning" takes place.
This chatbot aims to make medical diagnoses faster, easier, and more transparent for both patients and physicians – think of it like an intelligent version of WebMD that you can talk to. MedWhat is powered by a sophisticated machine learning system that offers increasingly accurate responses to user questions based on behaviors that it “learns” by interacting with human beings.
User message. Once authenticated, the user sends a message to the bot. The bot reads the message and routes it to a natural language understanding service such as LUIS. This step gets the intents (what the user wants to do) and entities (what things the user is interested in). The bot then builds a query that it passes to a service that serves information, such as Azure Search for document retrieval, QnA Maker for FAQs, or a custom knowledge base. The bot uses these results to construct a response. To give the best result for a given query, the bot might make several back-and-forth calls to these remote services.
Chatbots can have varying levels of complexity and can be stateless or stateful. A stateless chatbot approaches each conversation as if it was interacting with a new user. In contrast, a stateful chatbot is able to review past interactions and frame new responses in context. Adding a chatbot to a company's service or sales department requires low or no coding; today, a number of chatbot service providers that allow developers to build conversational user interfaces for third-party business applications.

To get started, you can build your bot online using the Azure Bot Service, selecting from the available C# and Node.js templates. As your bot gets more sophisticated, however, you will need to create your bot locally then deploy it to the web. Choose an IDE, such as Visual Studio or Visual Studio Code, and a programming language. SDKs are available for the following languages:
In other words, bots solve the thing we loathed about apps in the first place. You don't have to download something you'll never use again. It's been said most people stick to five apps. Those holy grail spots? They're increasingly being claimed by messaging apps. Today, messaging apps have over 5 billion monthly active users, and for the first time, people are using them more than social networks.
There are obvious revenue opportunities around subscriptions, advertising and commerce. If bots are designed to save you time that you’d normally spend on mundane tasks or interactions, it’s possible they’ll seem valuable enough to justify a subscription fee. If bots start to replace some of the functions that you’d normally use a search engine like Google for, it’s easy to imagine some sort of advertising component. Or if bots help you shop, the bot-maker could arrange for a commission.
If your interaction with a conversational bot is through a specific menu (where you interact through buttons but the bot does not understand natural language input), chances are you are talking to a bot with structured questions and responses. This type of bot is usually applied on messenger platforms for marketing purposes. They are great at conducting surveys, generating leads, and sending daily content pieces or newsletters.

Search for the bot you want to add. At the time of this writing, there are about a dozen bots available, with more being added every day. Chat bots are available for customer service, news, ordering, and more, depending on the company that releases it. For example, you could get news from the CNN bot and order flowers from the 1-800-flowers bot. The process for finding a bot varies depending on your device:[1]


If it happens to be an API call / data retrieval, then the control flow handle will remain within the ‘dialogue management’ component that will further use/persist this information to predict the next_action, once again. The dialogue manager will update its current state based on this action and the retrieved results to make the next prediction. Once the next_action corresponds to responding to the user, then the ‘message generator’ component takes over.
Have you checked out Facebook Messenger’s official page lately? Well, now you can start building your own bot directly through the platform’s landing page. This method though, may be a little bit more complicated than some of the previous ways we’ve discussed, but there are a lot of resources that Facebook Messenger provides in order to help you accomplish your brand new creation. Through full-fledged guides, case studies, a forum for Facebook developers, and more, you are sure to be a chatbot creating professional in no time.
Designing for conversational interfaces represents a big shift in the way we are used to thinking about interaction. Chatbots have less signifiers and affordances than websites and apps – which means words have to work harder to deliver clarity, cohesion and utility for the user. It is a change of paradigm that requires designers to re-wire their brain, their deliverables and their design process to create successful bot experiences.
In 1950, Alan Turing's famous article "Computing Machinery and Intelligence" was published,[7] which proposed what is now called the Turing test as a criterion of intelligence. This criterion depends on the ability of a computer program to impersonate a human in a real-time written conversation with a human judge, sufficiently well that the judge is unable to distinguish reliably—on the basis of the conversational content alone—between the program and a real human. The notoriety of Turing's proposed test stimulated great interest in Joseph Weizenbaum's program ELIZA, published in 1966, which seemed to be able to fool users into believing that they were conversing with a real human. However Weizenbaum himself did not claim that ELIZA was genuinely intelligent, and the introduction to his paper presented it more as a debunking exercise:
×