Improved performance, implemented caching improved error handling

[harshalmore31]

This pull request introduces Memori version 2.3.1, focusing on major performance optimizations, improved stability, and enhanced logging and error handling. The release includes significant caching for context and search results, thread pool management for background tasks, and better database connection pooling—especially for remote databases. Additionally, there are improvements to logging clarity, error reporting, and resource cleanup. Several code changes also address recursion issues in search operations and ensure more robust integration with third-party services.

Performance & Stability Improvements:

• Added context and search result caching, managed thread pool for background processing, and optimized SQLite and PostgreSQL connection pooling to reduce latency and improve throughput. Also includes cache cleanup and graceful shutdown procedures for better resource management. [1] [2] [3] [4]

Database Search & Recursion Fixes:

• Refactored search operations in retrieval_agent.py to use SearchService directly, preventing recursive context injection and improving reliability for keyword and category searches. [1] [2] [3]

Logging & Error Handling:

• Enhanced logging with more informative, structured messages (including session and chat ID truncation for clarity), improved error messages with exception types, and ensured logging is initialized before other operations. [1] [2] [3] [4] [5] [6]

OpenAI Integration & Safety:

• Added suppression of auto-recording for OpenAI API calls to avoid unwanted logging, and improved API key validation and error messaging in integration examples. [1] [2] [3] [4] [5]

Security & Maintenance:

• Updated the security workflow to ignore a specific pip vulnerability (GHSA-4xh5-x5gv-qwph) that does not affect supported Python versions, ensuring accurate vulnerability scanning.

These changes collectively result in faster, safer, and more reliable operation, particularly when working with remote databases and high-concurrency environments.

[github-actions]

Code Formatting Check

Great job! Your code is already properly formatted according to our standards:

• Black formatting
• Import sorting
• Ruff checks

No changes needed!

[github-actions]

Warning Security Scan Results

Some security scans failed, were skipped, or found issues.

Scan Type	Status
Dependency Scan	✅ Passed
Code Security	❌ Failed
Secrets Scan	✅ Passed

View detailed reports in the workflow artifacts (if available).

🔧 Workflow Information

• Workflow Run: #135
• Triggered by: pull_request
• Branch: fix-remotedb
• Commit: 06e8b79

[github-actions]

Warning Security Scan Results

Some security scans failed, were skipped, or found issues.

Scan Type	Status
Dependency Scan	✅ Passed
Code Security	❌ Failed
Secrets Scan	✅ Passed

View detailed reports in the workflow artifacts (if available).

🔧 Workflow Information

• Workflow Run: #182
• Triggered by: pull_request
• Branch: fix-remotedb
• Commit: 74fe7f1

[github-actions]

Code Formatting Check

Great job! Your code is already properly formatted according to our standards:

• Black formatting
• Import sorting
• Ruff checks

No changes needed!