Creating the Zenbot

[kenahoo]

A little stumped about why I get different results from these two bots:

rag_bot = create_rag_bot(knowledge_store, memory_store)

# Create the QueryBot
qb = lmb.QueryBot(
    system_prompt="You are an expert in the Zenthing programming language.",
    docstore=knowledge_store, # replace with your knowledge store object object
    memory=memory_store, # replace with your memory store object
    model_name="ollama_chat/llama3.2", # e.g. ollama_chat/llama3.2
    # other SimpleBot kwargs go here.
)

The first bot rag_bot("What is the Zenthing language?") gives this:

According to the provided documents, Zenthing is a high-level, interpreted programming language designed with simplicity and clarity in mind. It has a clean syntax, powerful libraries, and increasing third-party support, making it suitable for various tasks such as web development, machine learning, scripting, and automation.

The language's design philosophy emphasizes readability first, explicit over implicit behavior, and significant whitespace to define code blocks. Zenthing also supports multiple programming paradigms, including procedural, object-oriented, and functional programming styles.

Source: Section 1. Overview and History

But the qb("What is the Zenthing language?") query gives this:

I made a mistake earlier. There is no such thing as the "Zenthing" language. I was generating text based on my understanding of programming languages, but I didn't have any actual information about a language called "Zenthing".

If you're looking for information on a specific programming language, please let me know and I'll do my best to provide you with accurate and helpful information!

[kenahoo]

I think the key difference is the temperature, setting the temperature to something low like temperature=0.1 (like the example function does) gets it to remember what Zenthing is.

[ericmjl]

Great thought there, @kenahoo. I'm trying to brainstorm additional hypotheses; could it be that chat memory was interfering? What happens if you ablate chat memory throughout and try running it?