Add Session Connection Options and Fix Blocking Speech from High-latency LLM Generation

[toubatbrian]

1. This PR adds SessionConnectOptions to AgentSession. Making connection options configurable for TTS / STT / LLM.
2. Fix LLM node by making LLM inference stream cancellable via abortSignal. Allowing to cancel ongoing hanging speech handle due to high TTFT inference.

[changeset-bot]

🦋 Changeset detected

Latest commit: 07f25d8

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 15 packages

Name	Type
@livekit/agents-plugin-bey	Patch
@livekit/agents	Patch
@livekit/agents-plugin-anam	Patch
@livekit/agents-plugin-cartesia	Patch
@livekit/agents-plugin-deepgram	Patch
@livekit/agents-plugin-elevenlabs	Patch
@livekit/agents-plugin-google	Patch
@livekit/agents-plugin-inworld	Patch
@livekit/agents-plugin-livekit	Patch
@livekit/agents-plugin-neuphonic	Patch
@livekit/agents-plugin-openai	Patch
@livekit/agents-plugin-resemble	Patch
@livekit/agents-plugin-rime	Patch
@livekit/agents-plugin-silero	Patch
@livekit/agents-plugins-test	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[Hormold]

Looks good!

[davidzhao]

lg

[davidzhao]

this is failing CI though

[toubatbrian]

this is failing CI though

This one is a false alarm. github CI became flaky on Friday afternoon and any CI ran at that time automatically failed.