@Action return type and llm output binding limitation ?

[gabz57]

Hello, I'm playing with the library and found the error message Output of action ... is not of type ..., printed by MultiTransformationAction in the bindOutput method, and indeed I call the llm and expect a String using generateText(prompt : String) but the return type of the action is another object wrapping this response and other things.

I thought I could in someway run any arbitrary code inside an action (currently we don't have to call a llm inside each action), but if I call a LLM we may hit this constraint.

Maybe we would like to call several times the llm inside a single action (context.parallelMap method seems to suggest we can do that), each returning different types, I would like to know if this check is really necessary or if it could permit such a construction ?

[johnsonr]

It is possible to make several LLM calls in the one action. Get a PromptRunner instance from the OperationContext to do this.

You can use that with parallelMap or independently.