Langchain SQL Agent Bootstap

This is a simple App for testing LLM to SQL commands on a sqlite database using Langchain SQL Agent. The repo comes with a setup script that loads a sqlite database with some sample data.

This repo is intended to be a starter for Langchain and also a starter for programming with co-pilot GPT-4. The scope is small enough that you can even get by with copying/pasting whole clases to GPT-4 and asking for explanations or improvemnts to the code. There's a single important TODO item that is not and will not be ever completed, which is to implement the file upload functionality in the UI. The backend is already setup to handle file uploads (csv). If you're interested you could probably also:

• clean the ouput of the agent after each execution
• add a auto-refresh or a refresh button to the tables

Backend has several endpoints:

• /api/v1/tables - returns a list of tables in the database
• /api/v1/tables/<table_name> - returns a list of columns in the table
• /api/v1/run-command - takes a json payload with the command to execute and returns the results via a websocket
• /api/v1/upload - takes a csv file and loads it into the database

run-command is where all the fun is happening with the langchain sql agent.

Running locally

Pre-requisites

Backend was setup with Python 3.10.10

Frontend was setup with Node 18.15.0

Experience may vary with other versions

You have to have an open-api-api-key to use the langchain sql agent.

Copy the .env.example file to .env and add your key to the OPENAI_API_KEY variable. You can also change the model which is used to make predictions. In the time of writing, gpt-4 is in closed beta, so the backend might not work if you select that model.

Backend

Create virtual environment (only need to do this once)

python3 -m venv data-whisperer-backend/myenv

activate virtual environment

source data-whisperer-backend/myenv/bin/activate
# install dependencies
pip install -r data-whisperer-backend/requirements.txt

seed the database

python data-whisperer-backend/setup/create_and_seed_db.py

finally, run the backend

python data-whisperer-backend/run.py

Frontend

cd data-whisperer-frontend/
npm install # only need to do this once
npm start

Teardown

# deactivate virtual environment after you are done
deactivate