Chat Resolution Rate
Ticket Resolution Rate
Our client is a D2C ecommerce brand specializing in clothing, footwear and accessories. They have in-house processes for designing and manufacturing trending products. Since inception in 2012, they have sold 10 million+ products. With over 100k+ monthly queries, they needed an AI agent to quickly and accurately resolve repetitive user queries.
Being in D2C business, the customer query volume is high for our client. On a typical day, they receive 2-2.5k queries on chat and 500-600 on tickets. 70% of these were found to be repetitive and were regarding tracking orders, placing returns & checking refund status.
Before Robylon, they were using a deterministic flow chatbot to address the queries. Hence, only 50% chat queries were automated while ticketing remained completely manual.
To solve for this, they were looking for an AI agent that could fulfill the following criteria
Provide instant replies: Users want quick responses and even 10-15 seconds of wait can be frustrating. So the AI must not only be accurate, but also fast.
We studied the client’s specific requirements and devised our plans accordingly. We deployed 100+ pre-built ecommerce workflows, but also modified them as per the current context.
Here’s a step-by-step breakdown of how the AI automates customer support:
We made an intent identification engine. It was trained on 5k+ chats and 25k+ tickets. This exercise mapped a user’s intent with a list of keywords/ phrases they actually used.
Each new chat message/ ticket is passed through this AI engine to identify the user's intent. The intent could be easily identified even in free flowing or vague languages.
Example: If a user writes “order not received” in the chat, the AI would identify its intent as “Where is my order?”. Then, it would check the user’s order list to figure out which order is pending to be delivered.
Each intent identification is given a confidence score. For high confidence scores, the AI responds based on the respective SOP associated with the agent. If any additional data is needed, relevant APIs are triggered automatically and responses are accordingly generated.
Example: For the above example, AI would trigger APIs to fetch data from the delivery partners and update the user with “Sorry for the delay, your order would be delivered by 6pm today. You can track the order via this tracking link: XXX”
For intents with low confidence scores, or where AI is unable to generate satisfactory responses, the chat/ ticket is seamlessly handed over to a human agent. All the context is readily summarized and provided to the human agent to prevent further delays.
Example: In case the AI is unsure of why the particular order is still not delivered, the chat would be escalated to a human agent. “Apologies for the inconvenience. I am connecting you to an agent.”
The average per reply time is 3-6 seconds.
Overall, our AI agent is able to automatically resolve ~75% of the repetitive queries across chat and tickets combined. For chats, automated resolution increased from 50% to 85%; for ticketing, automation increased from 0% to 60%.
Speed is something that is critical in any D2C business, more so for ecommerce businesses. The response rate for AI model continues to improve and currently, it is able to generate responses within 3-6 seconds.
The AI responses are hyper-personalized too as it has access to all the user context : purchase history and past interactions with support across chats, tickets as well as human agents.