Agent memory langgraph long-term-memory using semantic search

[jennsun]

Created copy of agent-langgraph and added long term memory features

Note: frontend e2e-chatbot-app interface does not support passing in custom input/thread id, only invocation calls on the endpoint. Have filed a ticket to support passing in chatcontext via frontend interface so we can use user id for namespacing

example app: https://eng-ml-agent-platform.staging.cloud.databricks.com/apps/j-longtermagent?o=2850744067564480

Example local testing:

curl -X POST http://localhost:8000/invocations \
  -H "Content-Type: application/json" \
  -d '{
    "input": [{"role": "user", "content": "Remember that my favorite color is blue"}],
    "context": {"user_id": "test@example.com"}
  }'

output from above:

{"object":"response","output":[{"type":"function_call","id":"lc_run--019b059a-09ec-79c3-bcf2-640edb80d37a","call_id":"toolu_bdrk_013tUwgLNctjrTSSSUBWShXQ","name":"save_user_memory","arguments":"{\"memory_key\": \"favorite_color\", \"memory_data_json\": \"{\\\"favorite_color\\\": \\\"blue\\\"}\"}"},{"type":"function_call_output","call_id":"toolu_bdrk_013tUwgLNctjrTSSSUBWShXQ","output":"Successfully saved memory with key 'favorite_color' for user."},{"type":"message","id":"lc_run--019b059a-20c5-76a1-be57-308598158d43","content":[{"text":"Got it! I've remembered that your favorite color is blue. 💙","type":"output_text","annotations":[]}],"role":"assistant"}]}

Follow-up:

curl -X POST http://localhost:8000/invocations \
  -H "Content-Type: application/json" \
  -d '{
    "input": [{"role": "user", "content": "What is my favorite color?"}],
    "context": {"user_id": "test@example.com"}
  }'

Output:

{"object":"response","output":[{"type":"function_call","id":"lc_run--019b059e-a723-76f3-98cb-46737a1ae5f4","call_id":"toolu_bdrk_01QXVHEFgp3VedAuc63HW1b6","name":"get_user_memory","arguments":"{\"query\": \"favorite color\"}"},{"type":"function_call_output","call_id":"toolu_bdrk_01QXVHEFgp3VedAuc63HW1b6","output":"User memories:\n- {\"favorite_color\": \"blue\"}"},{"type":"message","id":"lc_run--019b059e-cbd9-7252-86ff-2ae05615c341","content":[{"text":"Your favorite color is blue!","type":"output_text","annotations":[]}],"role":"assistant"}]}

seeing store tables are ready in app logs:

ensure user preferences are stored in lakebase:

Currently, cannot use long-term memory via frontend because user id is not passed in to context. Also made sure you cannot access another user's memories via frontend

App postman request:

[bbqiu]

databricks/app-templates#86

closing for this PR