How's the response times?

[matthewford]

Hello, Thanks for sharing this code. I was looking for an agent framework. My use case is real-time communication, where latency matters; what are the typical response times with this? I would not be looking to use the TEE environment but as a library.

[zensh]

@matthewford The response time depends on the LLM's processing duration, hence it is contingent upon the LLM provider's load, potentially ranging from a few seconds to several tens of seconds.