This reference architecture describes how to build an enterprise-grade conversational bot (chatbot) using the Azure Bot Framework. Each bot is different, but there are some common patterns, workflows, and technologies to be aware of. Especially for a bot to serve enterprise workloads, there are many design considerations beyond just the core functionality. This article covers the most essential design aspects, and introduces the tools needed to build a robust, secure, and actively learning bot.
WeChat combines a chat-based interface with vast library of add-on features such as a mobile wallet, chat-based transactions, and chat-based media and interactive widgets, and exposes it all to businesses through a powerful API that enables businesses from mom and pop noodle shops to powerhouses such as Nike and Burberry to “friend” their customers and market to them in never before imaginable ways. Over 10MM businesses in China have WeChat accounts, and it is becoming increasingly popular for small businesses to only have a WeChat account, forgoing developing their own website or mobile app completely. US technology firms, in particular Facebook, are taking note.

WeChat was created by Chinese holding company Tencent three years ago. The product was created by a special projects team within Tencent (who also owns the dominant desktop messaging software in China, QQ) under the mandate of creating a completely new mobile-first messaging experience for the Chinese market. In three short years, WeChat has exploded in popularity and has become the dominant mobile messaging platform in China, with approximately 700M monthly active users (MAUs).
In our work at ZipfWorks building and scaling intelligent shopping platforms and applications, we pay close attention to emerging trends impacting digital commerce such as chatbots and mobile commerce. As this nascent trend towards a more conversational commerce ecosystem unfolds at a dizzying pace, we felt it would be useful to take a step back and look at the major initiatives and forces shaping this trend and compiled them here in this report. We’ve applied some of these concepts in our current project Dealspotr, to help more shoppers save more money through intelligent use of technology and social product design.
The front-end app you develop will interact with an AI application. That AI application—usually a hosted service—is the component that interprets user data, directs the flow of the conversation and gathers the information needed for responses. You can then implement the business logic and any other components needed to enable conversations and deliver results.
A chatbot is an automated program that interacts with customers like a human would and cost little to nothing to engage with. Chatbots attend to customers at all times of the day and week and are not limited by time or a physical location. This makes its implementation appealing to a lot of businesses that may not have the man-power or financial resources to keep employees working around the clock.
AllAgriculture (24) AI & ML (142) AR, VR, & MR (65) Asset Tracking (53) Blockchain (21) Building Automation (38) Connectivity (148) Bluetooth (12) Cellular (38) LPWAN (38) Data & Analytics (131) Devices & Sensors (174) Digital Transformation (189) Edge & Cloud Computing (54) Energy & Utilities (42) Finance & Insurance (10) Industrial IoT (101) IoT Platforms (81) Medical & Healthcare (47) Retail (28) Security (139) Smart City (88) Smart Home (91) Transport & Supply Chain (59) UI & UX (39) Voice Interaction (33)
The progressive advance of technology has seen an increase in businesses moving from traditional to digital platforms to transact with consumers. Convenience through technology is being carried out by businesses by implementing Artificial Intelligence (AI) techniques on their digital platforms. One AI technique that is growing in its application and use is chatbots. Some examples of chatbot technology are virtual assistants like Amazon's Alexa and Google Assistant, and messaging apps, such as WeChat and Facebook messenger.
Forrester just released a new report on mobile and new technology priorities for marketers, based on our latest global mobile executive survey. We found out that marketers: Fail to deliver on foundational mobile experiences. Consumers’ expectations of a brand’s mobile experience have never been higher. And yet, 58% of marketers agree that their mobile services […]
Expecting your customer care team to be able to answer every single inquiry on your social media profiles is not only unrealistic, but also extremely time-consuming, and therefore, expensive. With a chatbot, you're making yourself available to consumers 24 hours a day, seven days a week. Aside from saving you money, chatbots will help you keep your social media presence fresh and active.

An AI-powered chatbot is a smarter version of a chatbot (a machine that has the ability to communicate with humans via text or audio). It uses natural language processing (NLP) and machine learning (ML) to get a better understanding of the intent of humans it interacts with. Also, its purpose is to provide a natural, as near human-level communication as possible.
Expecting your customer care team to be able to answer every single inquiry on your social media profiles is not only unrealistic, but also extremely time-consuming, and therefore, expensive. With a chatbot, you're making yourself available to consumers 24 hours a day, seven days a week. Aside from saving you money, chatbots will help you keep your social media presence fresh and active.
Even if it sounds crazy, chatbots might even challenge apps and websites! An app requires space, it has to be downloaded. Websites take time to load and most of them are pretty slow. A bot works instantly. You type something, it replies. Another great thing about them is that they bypass user interface and completely change how customers interact with your business. People will navigate your content by using their natural language.
With competitor Venmo already established, peer-to-peer payments is not in and of itself a compelling feature for Snapchat. However, adding wallet functionality and payment methods to the app does lay the groundwork for Snapchat to delve directly into commerce. The messaging app’s commerce strategy became more clear in April 2016 with its launch of shoppable stories with select partners in its Discover section. For the first time, while viewing video stories from Target and Lancome, users were able to “swipe up” to visit an e-commerce page embedded within the Snapchat app where they could purchase products from those partners.

Marketing teams are increasingly interested in leveraging branded chatbots, but most struggle to deliver business value. My recently published report, Case Study: Take A Focused And Disciplined Approach To Drive Chatbot Success, shows how OCBC Bank in Singapore is bucking the trend: The bank recently created Emma, a chatbot focused on home loan leads, which […]
ELIZA's key method of operation (copied by chatbot designers ever since) involves the recognition of cue words or phrases in the input, and the output of corresponding pre-prepared or pre-programmed responses that can move the conversation forward in an apparently meaningful way (e.g. by responding to any input that contains the word 'MOTHER' with 'TELL ME MORE ABOUT YOUR FAMILY'). Thus an illusion of understanding is generated, even though the processing involved has been merely superficial. ELIZA showed that such an illusion is surprisingly easy to generate, because human judges are so ready to give the benefit of the doubt when conversational responses are capable of being interpreted as "intelligent".

Businesses are no exception to this rule. As more and more users now expect and prefer chat as a primary mode of communication, we’ll begin to see more and more businesses leveraging conversational AI to achieve business goals—just as Gartner predicts. It’s not just for the customer; your business can reduce operational costs and scale operations as well.

“There is hope that consumers will be keen on experimenting with bots to make things happen for them. It used to be like that in the mobile app world 4+ years ago. When somebody told you back then… ‘I have built an app for X’… You most likely would give it a try. Now, nobody does this. It is probably too late to build an app company as an indie developer. But with bots… consumers’ attention spans are hopefully going to be wide open/receptive again!” — Niko Bonatsos, Managing Director at General Catalyst
This is the big one. We worked with one particular large publisher (can’t name names unfortunately, but hundreds of thousands of users) in two phases. We initially released a test phase that was sort of a “catch all”. Anyone could message a broad keyword to their bot and start a campaign. Although we had a huge number of users come in, engagement was relatively average (87% open rate and 27.05% click-through rate average over the course of the test). Drop off here was fairly high, about 3.14% of users had unsubscribed by the end of the test.
It may be tempting to assume that users will navigate across dialogs, creating a dialog stack, and at some point will navigate back in the direction they came from, unstacking the dialogs one by one in a neat and orderly way. For example, the user will start at root dialog, invoke the new order dialog from there, and then invoke the product search dialog. Then the user will select a product and confirm, exiting the product search dialog, complete the order, exiting the new order dialog, and arrive back at the root dialog.
Love them or hate them, chatbots are here to stay. Chatbots have become extraordinarily popular in recent years largely due to dramatic advancements in machine learning and other underlying technologies such as natural language processing. Today’s chatbots are smarter, more responsive, and more useful – and we’re likely to see even more of them in the coming years.
Let’s take a weather chat bot as an example to examine the capabilities of Scripted and Structured chatbots. The question “Will it rain on Sunday?” can be easily answered. However, if there is no programming for the question “Will I need an umbrella on Sunday?” then the query will not be understood by the chat bot. This is the common limitation with scripted and structured chatbots. However, in all cases, a conversational bot can only be as intelligent as the programming it has been given.
2. Flow-based: these work on user interaction with buttons and text. If you have used Matthew’s chatbot, that is a flow-based chatbot. The chatbot asks a question then offers options in the form of buttons (Matthew’s has a yes/no option). These are more limited, but you get the possibility of really driving down the conversation and making sure your users don’t stray off the path.
The fact that you can now run ads directly to Messenger is an enormous opportunity for any business. This skips the convoluted and leaky process of trying to acquire someone's email address to nurture them outside of Facebook's platform. Instead, you can retain the connection with someone inside Facebook and improve the overall conversion rates to receiving an engagement.
The most widely used anti-bot technique is the use of CAPTCHA, which is a form of Turing test used to distinguish between a human user and a less-sophisticated AI-powered bot, by the use of graphically-encoded human-readable text. Examples of providers include Recaptcha, and commercial companies such as Minteye, Solve Media, and NuCaptcha. Captchas, however, are not foolproof in preventing bots as they can often be circumvented by computer character recognition, security holes, and even by outsourcing captcha solving to cheap laborers.
Creating a comprehensive conversational flow chart will feel like the greatest hurdle of the process, but know it's just the beginning. It's the commitment to tweaking and improving in the months and years following that makes a great bot. As Clara de Soto, cofounder of Reply.ai, told VentureBeat, "You're never just 'building a bot' so much as launching a 'conversational strategy' — one that's constantly evolving and being optimized based on how users are actually interacting with it."
When you have a desperate need for a java fix with minimal human interaction and effort, this bot has you covered. According to a demo led by Gerri Martin-Flickinger, the coffee chain's chief technology officer, the bot even understands complex orders with special requests, like "double upside down macchiato half decaf with room and a splash of cream in a grande cup."
Conversational bots “live” online and give customers a familiar experience, similar to engaging an employee or a live agent, and they can offer that experience in higher volumes. Conversational bots offer scaling—or the capability to perform equally well under an expanding workload—in ways that human can’t, assisting businesses to reach customers in a way they couldn’t before. For one, businesses have created 24/7/365 online presence through conversational bots.
Chatbots can direct customers to a live agent if the AI can’t settle the matter. This lets human agents focus their efforts on the heavy lifting. AI chatbots also increase employee productivity. Globe Telecom automated their customer service via Messenger and saw impressive results. The company increased employee productivity by 3.5 times. And their customer satisfaction increased by 22 percent.
Of course, it is not so simple to create an interactive agent that the user will really trust. That’s why IM bots have not replaced all the couriers, doctors and the author of these lines. In this article, instead of talking about the future of chatbots, we will give you a short excursion into the topic of chatbots, how they work, how they can be employed and how difficult it is to create one yourself.
Eventually, a single chatbot could become your own personal assistant to take care of everything, whether it's calling you an Uber or setting up a meeting. Or, Facebook Messenger or another platform might let a bunch of individual chatbots to talk to you about whatever is relevant — a chatbot from Southwest Airlines could tell you your flight's delayed, another chatbot from FedEx could tell you your package is on the way, and so on.
Your first question is how much of it does she want? 1 litre? 500ml? 200? She tells you she wants a 1 litre Tropicana 100% Orange Juice. Now you know that regular Tropicana is easily available, but 100% is hard to come by, so you call up a few stores beforehand to see where it’s available. You find one store that’s pretty close by, so you go back to your mother and tell her you found what she wanted. It’s $2, maybe $3, and after asking her for the money, you go on your way.

The evolution of artificial intelligence is now in full swing and chatbots are only a faint splash on a huge wave of progress. Today the number of users of messaging apps like WhatsApp, Slack, Skype and their analogs is skyrocketing, Facebook Messenger alone has more than 1.2 billion monthly users. With the spread of messengers, virtual chatterbots that imitate human conversations for solving various tasks are becoming increasingly in demand. Chinese WeChat bots can already set medical appointments, call a taxi, send money to friends, check in for a flight and many many other.

Marketers’ interest in chatbots is growing rapidly. Globally, 57% of firms that Forrester surveyed are already using chatbots or plan to begin doing so this year. However, marketers struggle to deliver value. My latest report, Chatbots Are Transforming Marketing, shows B2C marketing professionals how to use chatbots for marketing by focusing on the discover, explore, […]


“It’s hard to balance that urge to just dogpile the latest thing when you’re feeling like there’s a land grab or gold rush about to happen all around you and that you might get left behind. But in the end quality wins out. Everyone will be better off if there’s laser focus on building great bot products that are meaningfully differentiated.” — Ryan Block, Cofounder of Begin.com
Once you’ve determined these factors, you can develop the front-end web app or microservice. You might decide to integrate a chatbot into a customer support website where a customer clicks on an icon that immediately triggers a chatbot conversation. You could also integrate a chatbot into another communication channel, whether it’s Slack or Facebook Messenger. Building a “Slackbot,” for example, gives your users another way to get help or find information within a familiar interface.

Consumers really don’t like your chatbot. It’s not exactly a relationship built to last — a few clicks here, a few sentences there — but Forrester Analytics data shows us very clearly that, to consumers, your chatbot isn’t exactly “swipe right” material. That’s unfortunate, because using a chatbot for customer service can be incredibly effective when done […]
Respect the conversational UI. The full interaction should take place natively within the app. The goal is to recognize the user's intent and provide the right content with minimum user input. Every question asked should bring the user closer to the answer they want. If you need so much information that you're playing a game of 20 Questions, then switch to a form and deliver the content another way.
If AI struggles with fourth-grade science question answering, should AI be expected to hold an adult-level, open-ended chit-chat about politics, entertainment, and weather? It is thus encouraging to see that Microsoft’s Satya Nadella did not give up on Tay after its debacle, and Amazon’s Jeff Bezos is sponsoring an Alexa social chatbot competition. I love this below quote from Jeff:
As the above chart (source) illustrates, email click-rate has been steadily declining. Whilst open rates seem to be increasing - largely driven by mobile - the actual engagement from email is nosediving. Not only that, but it's becoming more and more difficult to even reach someone's email inbox; Google's move to separate out promotional emails into their 'promotions' tab and increasing problems of email deliverability have been top reasons behind this.
Kik is one of the most popular chat apps among teens with 275M MAUs and 40% of those are in the 13–24 year old demographic. In April, Kik launched its own bot store with 16 launch partners including Sephora, H&M, Vine, the Weather Channel, and Funny or Die. Using Kik’s bots currently feel like using the internet in 1994, very rough around the edges and limited functionality / usefulness. However, we’ll see how their API and bots progress over time, Kik’s popularity among an attractive demographic might convince some brands to invest in the platform.

I will not go into the details of extracting each feature value here. It can be referred from the documentation of rasa-core link that I provided above. So, assuming we extracted all the required feature values from the sample conversations in the required format, we can then train an AI model like LSTM followed by softmax to predict the next_action. Referring to the above figure, this is what the ‘dialogue management’ component does. Why LSTM is more appropriate? — As mentioned above, we want our model to be context aware and look back into the conversational history to predict the next_action. This is akin to a time-series model (pls see my other LSTM-Time series article) and hence can be best captured in the memory state of the LSTM model. The amount of conversational history we want to look back can be a configurable hyper-parameter to the model.
The term "ChatterBot" was originally coined by Michael Mauldin (creator of the first Verbot, Julia) in 1994 to describe these conversational programs.[2] Today, most chatbots are accessed via virtual assistants such as Google Assistant and Amazon Alexa, via messaging apps such as Facebook Messenger or WeChat, or via individual organizations' apps and websites.[3][4] Chatbots can be classified into usage categories such as conversational commerce (e-commerce via chat), analytics, communication, customer support, design, developer tools, education, entertainment, finance, food, games, health, HR, marketing, news, personal, productivity, shopping, social, sports, travel and utilities.[5]
×