Skip to main content

Stop your chatbot from ‘going rogue’

Many businesses are now adding AI like ChatGPT to their chatbots, in an attempt to provide a more personable service to their users. Unfortunately, some of these chatbots are being exploited. DPD’s chatbot swore at its user and criticised the company, and Chevrolet of Watsonville’s chatbot sold a car for $1. What does this mean for businesses using chatbots?

Are chatbots impossible to keep in check?

ChatGPT and similar AI Language models are being integrated into chatbots like these in order to provide a more human-like service, with instant results. However, as with all new technology, users are interested in testing its capabilities and its limits. 

Whilst the users chatting to DPD and Chevrolet of Watsonville did manage to exploit the chatbots and push them outside of their predetermined responses, it is important to note that these are not typical users. The vast majority of people are more likely to use your chatbots to get their enquiries answered quickly and easily, rather than find loopholes in its programming. 

Your chatbot needs to be prepared

Although these aren’t typical users, businesses do need to be prepared for these kinds of issues when implementing a chatbot or AI into their systems. There are a number of things that you can do to ensure that the AI you are using follows your instructions and operates in line with your requirements. 

1. Set some ground rules

When you’re setting up your chatbot, you need to clearly define what it is permitted to do, and what it is not permitted to do within your business. Setting out the ground rules for your chatbot will mean that it is far less likely to go rogue, and start offering cars for $1. 

Think about what this might look like for your business. You might be happy for the chatbot to offer your opening hours, a return policy or a summary of one of the services you offer, but would you feel confident in a chatbot registering a user for an event? How would you want it to respond if it was asked for legal or financial advice? What would happen if someone attempted to make a purchase through a chatbot?

To ensure that your chatbot works in the way you want it to, set some limits on how it manages sensitive data, how it responds when a user asks for personalised advice, and the extent to which it can facilitate a customer through a purchase. Remember, as a business, you are still responsible for GDPR and cybersecurity - whether your chatbot adheres to it or not.

2. Don’t dump your customer service team

These limitations only work alongside an informed, dedicated customer service team. Whilst it is likely that a chatbot can answer many of the lower level queries submitted by users, when something falls outside of its capabilities, it is essential that the user is directed towards a real person.

Make sure that you outline what happens when a query is too much for your chatbot; is it forwarded to the entire customer service team? Are they asked to contact the team directly, or does the chatbot do it automatically? If so, does it collect any data from the user, and is that data collected in line with your company policies, and GDPR?

3. Test, test, test

It is essential that you test your chatbot repeatedly and regularly. This is the only way to ensure that the limitations that you have put in place are adhered to, queries that the chatbot can’t answer are sent to a real person, and inappropriate requests or enquiries are not responded to.

Where possible, have a disclaimer on your website that the chatbot cannot offer any personalised advice, and outline appropriate use of your chatbot in your terms and conditions. Follow these steps, and keep your chatbot updated with the correct information, and you should be able to offer a better service to your end user - without your chatbot going rogue.

Thinking about adding AI to your business? Transcendit can help. Give us a call on 0191 482 0444 to find out how.


The Transcendit Way

Transcendit understand that when you choose to work with us, whether we're taking care of your IT, app or web development, you're trusting us with part of your business. So whether we're looking after your computers, phone systems or servers we always do things 'the Transcendit way'.

The whole of our team adhere to the same values, beliefs and policies - the principles that were written when Transcendit first formed in 2000. Whether you come to us for cloud services or recovery backup you can be confident that you'll always receive the same excellent service.

The Transcendit way outlines how we do business; following the same straightforward principles with every client and customer, regardless of how big or small they may be.

That means we get to know you and your business. We offer you a friendly, professional and efficient service, and we'll always be honest with you.
We understand that not everybody speaks fluent IT, so we try to explain things in a way that is simple and clear. We always spend as much time as is necessary explaining things to you.
If you need to talk to us about something, no matter how insignificant, we are only ever a phone call away – and we’re never too busy to make you a cup of tea and have a sit down with you in person.
We understand how frustrating it can be when things are late. When we schedule an appointment with you, we are there when you’re expecting us. If something prevents us from getting there, we always call you in advance to let you know.
Sometimes things can go wrong, but we never lie to you or try to cover something up. If things go askew we tell you what’s happened and how we plan to prevent it affecting your business.
We want you to continuously benefit from working with us. We regularly discuss your business and make suggestions for improving systems and processes wherever we can – but we never try to push you into a purchase.
When we quote a fixed price, that's always the amount we charge – you won’t find any nasty surprises on a bill from us. If you are paying by time and materials, we inform you if our approximations could change.
We understand the importance of privacy for your business and your customers. We respect the confidentiality of your data, and we will never pass on your information to third parties.
We appreciate it when you take the time to give us feedback. A system called CustomerSure records our client's responses, so you can trust that our reviews are from real people.
Find out what they're saying here.
Paul is always more than helpful...we'd be lost without him! Angela Fenwick, Streetwise

Based on 11207 reviews our customers rate us 9.8/10. Reviews and ratings by Customersure. 17-January-2024

Transcendit are proud sponsors of CHUF, the Children's Heart Unit Fund.

Transcendit is a Living Wage employer
Transcendit is a Microsoft Gold certified partner
VMWARE partner
Vipre partner
IPCortex partner
WithSecure partner
DELL partner
Barracuda partner
Veeam partner
N-Able partner