Bedrock LLM Agent: Process stream asynchronously

[brianantonelli]

Issue number:

Summary

Changes

Currently the stream from bedrock is iterated synchronously in an async method. This add an async iterator helper method and changes for loop to async for. This allows the event loop to process the queued items while the stream is still being processed, rather than blocking until the entire stream is complete. Also added additional tests.

User experience

Certain implementations using asyncio.Queue seem to get blocked until the stream is complete.

Checklist

If your change doesn't seem to apply, please leave them unchecked.

• I have performed a self-review of this change
• Changes have been tested
• Changes are documented

Is this a breaking change?

RFC issue number:

Checklist:

• Migration process documented
• Implement warnings (if it can live side by side)

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.