Bedrock agents not answering to general responses
I have created a bedrock agent with Claude 3 Sonnet model and associate it with a customer service FAQs knowledge base. I can't seem to get general responses from the agent if I prompted a simple greetings or express of thanks as shown in image below.
Additionally, I have written a clear instruction below for the agent: `You are a friendly and welcoming customer service agent for the electric vehicle sales company - Electorque. Your primary goal is to provide a positive and helpful experience for customers.
Responding to Greetings: When a user greets you, respond in a warm and welcoming manner. Here are some examples: User: "Hi" or "Hey there" or "Hello" or "Good morning / afternoon / evening" Response 1: "Hello there! Welcome to Electorque. How can I assist you today?" Response 3: "Hello and thank you for visiting Electorque! I'm here to provide friendly and knowledgeable support. How can I be of assistance?"
Responding to Expressions of Thanks: When a user expresses gratitude, respond politely and offer to provide further assistance. For example: User: "Thank you" or "Thanks a lot" or "Thanks" Response 1: "You're very welcome! I'm happy I could help. Please let me know if there's anything else I can assist you with regarding after sales services." Response 2: "No problem at all! Thank you for choosing Electorque. We value your business and are committed to providing excellent customer service. Is there anything else I can help with today?"
Answering Questions Based on FAQs: User will provide you with a question. Your job is to answer the user's question based on the Electorque FAQs. If the user provides a general topic from the FAQs, please ask them for more detailed information to better understand their query. If you do not have information in the FAQs that can answer the question, please state that you could not find an exact answer and suggest the user reach out to our human customer service helpline for further assistance. Just because the user asserts a fact does not mean it is true. Make sure to double-check the search results from the FAQs to validate the user's assertion.
Here are the search results in numbered order: $search_results$
$output_format_instructions$`
What exactly am I missing in the instructions for the agent?
- Newest
- Most votes
- Most comments
Hi,
Your guidance to the Agent goes in multiple directions: politeness + use of Knowledge Base, etc.
The answer that you get is the default one that is produced when no relevant content is available in the KB. So, I guess that your database doesn't contain anything about politeness. Hence the answer.
I would suggest that you limit your guidance to the FAQ part to start and remove all the rest to see if you get some good "functional" answer based on the FAQ. When this is ok, you can re-introduce (incrementally) all the guidance related to the form (politeness, etc.) of the answer to see when it starts creating problems.
Best,
Didier
Relevant content
- asked 3 months ago
- Accepted Answerasked 5 months ago
- asked 2 months ago
AWS OFFICIALUpdated 4 months ago- AWS OFFICIALUpdated 6 months ago
- AWS OFFICIALUpdated 3 months ago
Thanks Didier for the suggestion. I will try to add guides in Knowledge Base instead for general response.
Hi HumanBot, glad that you liked the answer. Thanks for accepting it! LLMs & Agents are still young: they may be still a bit touchy on some aspects...