Deep Dive into LlamaIndex Workflow: Event-Driven LLM Architecture | by Peng Qian | Dec, 2024

Editor
1 Min Read


Progress and shortcomings after practice

Deep Dive into LlamaIndex Workflows: Event-driven LLM architecture.
Deep Dive into LlamaIndex Workflows: Event-driven LLM architecture. Image by DALL-E-3

Recently, LlamaIndex introduced a new feature called Workflow in one of its versions, providing event-driven and logic decoupling capabilities for LLM applications.

In today’s article, we’ll take a deep dive into this feature through a practical mini-project, exploring what’s new and still lacking. Let’s get started.

More and more LLM applications are shifting towards intelligent agent architectures, expecting LLMs to meet user requests through calling different APIs or multiple iterative calls.

This shift, however, brings a problem: as agent applications make more API calls, program responses slow down and code logic becomes more complex.

A typical example is ReActAgent, which involves steps like Thought, Action, Observation, and Final Answer, requiring at least three LLM calls and one tool call. If loops are needed, there will be even more I/O calls.

A typical ReAct agent will make at least three calls to LLM.
A typical ReAct agent will make at least three calls to LLM. Image by Author
Share this Article
Please enter CoinGecko Free Api Key to get this plugin works.