Skip to content

Commit 7f6fa79

Browse files
authored
Merge pull request #624 from maryamkhidir/release/feature-app
feat: Application configuration
2 parents 6117b0d + 1efd010 commit 7f6fa79

File tree

213 files changed

+13325
-4689
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

213 files changed

+13325
-4689
lines changed

NOTICE

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -258,7 +258,7 @@ Author: Leonard Richardson
258258

259259
The following Python packages may be included in this product:
260260

261-
- numpy==1.26.0
261+
- numpy==1.26.4
262262

263263
These packages each contain the following license and notice below:
264264

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Deploying a Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS
1+
# Building RAG use cases with GenAI Chatbot on AWS
22

33
[![Release Notes](https://img.shields.io/github/v/release/aws-samples/aws-genai-llm-chatbot)](https://github.com/aws-samples/aws-genai-llm-chatbot/releases)
44
[![GitHub star chart](https://img.shields.io/github/stars/aws-samples/aws-genai-llm-chatbot?style=social)](https://star-history.com/#aws-samples/aws-genai-llm-chatbot)
@@ -8,7 +8,7 @@
88

99
[![Full Documentation](https://img.shields.io/badge/Full%20Documentation-blue?style=for-the-badge&logo=Vite&logoColor=white)](https://aws-samples.github.io/aws-genai-llm-chatbot/)
1010

11-
![sample](docs/about/assets/chabot-sample.gif "AWS GenAI Chatbot")
11+
![sample](docs/about/assets/chabot-sample.gif "GenAI Chatbot on AWS")
1212

1313

1414
## 🚀 NEW! Support for new Amazon Nova Models 🚀
@@ -35,7 +35,7 @@ This solution provides ready-to-use code so you can start **experimenting with a
3535

3636
Supported model providers:
3737

38-
- [Amazon Bedrock](https://aws.amazon.com/bedrock/) which supports a wide range of models from AWS, Anthropic, Cohere and Mistral including the lastst models from Amazon Nova. See [Recent announcements](#) for more details.
38+
- [Amazon Bedrock](https://aws.amazon.com/bedrock/) which supports a wide range of models from AWS, Anthropic, Cohere and Mistral including the latest models from Amazon Nova. See [Recent announcements](https://aws.amazon.com/blogs/aws/introducing-amazon-nova-frontier-intelligence-and-industry-leading-price-performance/) for more details.
3939
- [Amazon SageMaker](https://aws.amazon.com/sagemaker/) self-hosted models from Foundation, Jumpstart and HuggingFace.
4040
- Third-party providers via API such as Anthropic, Cohere, AI21 Labs, OpenAI, etc. [See available langchain integrations](https://python.langchain.com/docs/integrations/llms/) for a comprehensive list.
4141

boto3-1.35.58-py3-none-any.whl

-136 KB
Binary file not shown.

botocore-1.35.58-py3-none-any.whl

-12.2 MB
Binary file not shown.

cli/magic-config.ts

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -354,7 +354,9 @@ async function processCreateOptions(options: any): Promise<void> {
354354
{
355355
type: "confirm",
356356
name: "guardrailsEnable",
357-
message: "Do you want to enable Bedrock Guardrails",
357+
message:
358+
"Do you want to enable Bedrock Guardrails? This is a recommended feature to build responsible AI applications." +
359+
" (Supported by all models except Idefics via SageMaker. If enabled, streaming will only work with Bedrock)",
358360
initial: options.guardrailsEnable ?? false,
359361
},
360362
{
@@ -381,7 +383,7 @@ async function processCreateOptions(options: any): Promise<void> {
381383
{
382384
type: "confirm",
383385
name: "enableSagemakerModels",
384-
message: "Do you want to use any text generation Sagemaker Models",
386+
message: "Do you want to use any text generation SageMaker Models",
385387
initial: options.enableSagemakerModels || false,
386388
},
387389
{

docs/.vitepress/config.mts

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,8 +2,8 @@ import { defineConfig } from 'vitepress'
22

33
// https://vitepress.dev/reference/site-config
44
export default defineConfig({
5-
title: "AWS GenAI LLM Chatbot",
6-
description: "Deploying a Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS",
5+
title: "GenAI Chatbot on AWS",
6+
description: "Building RAG use cases with GenAI Chatbot on AWS",
77
base: "/aws-genai-llm-chatbot/",
88
themeConfig: {
99
// https://vitepress.dev/reference/default-theme-config
@@ -44,13 +44,16 @@ export default defineConfig({
4444
text: 'Guide',
4545
items: [
4646
{ text: 'Deploy', link: '/guide/deploy' },
47+
{ text: 'Configuration', link: '/guide/config' },
4748
{ text: 'Developer Guide', link: '/guide/developers' },
4849
{ text: 'Development Prioritization', link: '/guide/prioritization' },
4950
]
5051
},
5152
{
5253
text: 'Documentation',
5354
items: [
55+
{ text: 'Access Control', link: '/documentation/access-control' },
56+
{ text: 'Applications', link: '/documentation/applications' },
5457
{ text: 'AppSync', link: '/documentation/appsync' },
5558
{ text: 'CloudFront Geo Restriction', link: '/documentation/cf-geo-restriction' },
5659
{
@@ -67,7 +70,7 @@ export default defineConfig({
6770
{ text: 'Precautions', link: '/documentation/precautions' },
6871
{ text: 'Private Chatbot', link: '/documentation/private-chatbot' },
6972
{ text: 'SageMaker Schedule', link: '/documentation/sagemaker-schedule' },
70-
{ text: 'Security', link: '/documentation/vulnerability-scanning' },
73+
{ text: 'Security', link: '/documentation/security' },
7174
{ text: 'Self-hosted models', link: '/documentation/self-hosted-models' },
7275
]
7376
}

docs/about/assets/application.gif

5.64 MB
Loading

docs/about/aws-resources-deployed.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,8 @@ Please note: This is list is considered a best effort approach to helping you un
1616
* **User Pool** [**Required**]
1717
* **User Pool Client** [**Required**]
1818
* Attach an existing Cognito Domain for Federation, adds Permission for User Pool to leverage existing Cognito Domain / Creates OIDC or SAML Identity Provider in Cognito [*Optional*]
19+
* **User Groups** [**Required**]
20+
* Admin and workspace_manager roles allow applications (configurable chatbots) and workspace management retrospectively.
1921

2022
## Retrieval Augmented Generation (RAG) Engines
2123
This section describes the RAG engines that house and return stored data for use with Generative AI. Additionally this section includes resources deployed to support data ingestion and processing for RAG.

docs/about/features.md

Lines changed: 12 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ Supported model providers:
1414

1515
Deploy [IDEFICS](https://huggingface.co/blog/idefics) models on [Amazon SageMaker](https://aws.amazon.com/sagemaker/) and see how the chatbot can answer questions about images, describe visual content, generate text grounded in multiple images.
1616

17-
![sample](./assets/multimodal-sample.gif "AWS GenAI Chatbot")
17+
![sample](./assets/multimodal-sample.gif "GenAI Chatbot on AWS")
1818

1919
Currently, the following multimodal models are supported:
2020

@@ -36,13 +36,13 @@ and select one of the supported models (press Space to select/deselect) from the
3636

3737
Send the same query to 2 to 4 separate models at once and see how each one responds based on its own learned history, context and access to the same powerful document retriever, so all requests can pull from the same up-to-date knowledge.
3838

39-
![sample](./assets/multichat-sample.gif "AWS GenAI Chatbot")
39+
![sample](./assets/multichat-sample.gif "GenAI Chatbot on AWS")
4040

4141
## Experiment with multiple RAG options with Workspaces
4242

4343
A workspace is a logical namespace where you can upload files for indexing and storage in one of the vector databases. You can select the embeddings model and text-splitting configuration of your choice.
4444

45-
![sample](./assets/create-workspace-sample.gif "AWS GenAI Chatbot")
45+
![sample](./assets/create-workspace-sample.gif "GenAI Chatbot on AWS")
4646

4747
## Unlock RAG potentials with Workspaces Debugging Tools
4848

@@ -52,7 +52,7 @@ The solution comes with several debugging tools to help you debug RAG scenarios:
5252
- Test different embeddings models directly in the UI
5353
- Test cross encoders and analyse distances from different functions between sentences.
5454

55-
![sample](./assets/workspace-debug-sample.gif "AWS GenAI Chatbot")
55+
![sample](./assets/workspace-debug-sample.gif "GenAI Chatbot on AWS")
5656

5757
## Full-fledged User Interface
5858

@@ -63,3 +63,11 @@ Protected with [Amazon Cognito Authentication](https://aws.amazon.com/cognito/)
6363
The interface layer between the UI and backend is built with [AppSync](https://docs.aws.amazon.com/appsync/latest/devguide/what-is-appsync.html) for management requests and for realtime interaction with chatbot (messages and responses) using GraphQL subscriptions.
6464

6565
Design system provided by [AWS Cloudscape Design System](https://cloudscape.design/).
66+
67+
## Configure and customize chatbots for different domains
68+
69+
The solution supports creating configurable chatbots called **applications**. Admin users can define applications by selecting a model, model settings, workspace, and system prompts. Configured applications are then available for regular users based on their assigned role, allowing controlled access to pre-configured chat experiences.
70+
71+
Roles determine which applications a user can access - for example, a "customer support" role may only be able to use applications tailored for handling support inquiries from users. Additional roles can be created as needed to cater applications to specific user groups or departments.
72+
73+
![sample](./assets/application.gif "GenAI Chatbot on AWS")

docs/about/welcome.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
layout: doc
33
---
44

5-
# Deploying a Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS
5+
# Building RAG use cases with GenAI Chatbot on AWS
66

77
[![Release Notes](https://img.shields.io/github/v/release/aws-samples/aws-genai-llm-chatbot)](https://github.com/aws-samples/aws-genai-llm-chatbot/releases)
88

@@ -12,9 +12,9 @@ layout: doc
1212

1313
[![Deploy with GitHub Codespaces](https://github.com/codespaces/badge.svg)](#deploy-with-github-codespaces)
1414

15-
The AWS GenAI LLM Chatbot provides ready-to-use code so you can start experimenting with a variety of Large Language Models and Multimodal Language Models, settings and prompts in your own AWS account.
15+
The GenAI Chatbot on AWS provides ready-to-use code so you can start experimenting with a variety of Large Language Models and Multimodal Language Models, settings and prompts in your own AWS account.
1616

17-
![sample](./assets/chabot-sample.gif "AWS GenAI Chatbot")
17+
![sample](./assets/chabot-sample.gif "GenAI Chatbot on AWS")
1818

1919
Want to find out more? Continue to [Features](./features).
2020

0 commit comments

Comments
 (0)