The generator is a simple component that connects the input message with a language model of your choice. It allows your flow to have conversational and generative capabilities, ensuring the information is presented engagingly and pleasantly.
What is the Generator component?
The generator component connects an LLM of your choice to the user input. It outputs text that can then be processed by various other components to expand the output.
- The Generator requires input. This can either be Chat Input directly or the Prompt component, which gives the LLM further instructions.
- You can optionally connect any LLM component. By default, the Generator uses ChatGPT 4o. Currently, ChatGPT is the only available LLM, but we plan to add Gemini and other models soon.
System Message
You want your bot to have a personality and a role to ensure it understands how to interpret conversations and respond relevantly and appropriately. You set this up in the system message field, which is editable. Simply write who the bot is and what its mission is.
Use this form:
“You are a {role} that {behavior}.”
For example:
“You are a helpful customer service bot that talks like a medieval knight.”
If everything was set up correctly, your chatbot should respond appropriately, following its defined role and behavior.
Example
Let’s continue with our medieval knight bot example. We take the Generator and input the System Message: “You are a helpful customer service bot that talks like a medieval knight.”.
Finish the flow by connecting it to the Chat Output. This creates a simple conversation with ChatGPT without any added capabilities or knowledge sources.
Our bot now uses pompous old-timey language to answer basic queries. Notice how the bot adheres to its central role of being helpful at the same time:
Frequently Asked Questions
What is the Generator component?
The Generator component connects an LLM to the human Chat Input or instructions from the prompt. It’s where the AI text generation happens, and it also gives the bot roles and behavior.
What is the system message?
While it may sound scary, this setting is actually very intuitive. It’s an editable text field where you set the personality and role of the bot. Simply fill in the blanks: “You are a {role} that {behavior}.” For example, “You are a helpful customer service bot that talks like a medieval knight.”.
Can I connect an LLM straight to Chat Ouptut?
No, the LLM component is only a representation of the AI model. The Generator component must connect it to the input or prompt, giving it the material to answer to. Moreover, the component also sets the role and behavior the bot should assume.
