LlamaIndex goes beyond RAG so agents can make complex decisions

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Popular AI orchestration framework LlamaIndex has introduced Agent Document Workflow (ADW) a new architecture that the company says goes beyond retrieval-augmented generation (RAG) processes and increases agent productivity. 

As orchestration frameworks continue to improve, this method could offer organizations an option for enhancing agents’ decision-making capabilities. 

LlamaIndex says ADW can help agents manage “complex workflows beyond simple extraction or matching.”

Some agentic frameworks are based on RAG systems, which provide agents the information they need to complete tasks. However, this method does not allow agents to make decisions based on this information. 

LlamaIndex gave some real-world examples of how ADW would work well. For instance, in contract reviews, human analysts must extract key information, cross-reference regulatory requirements, identify potential risks and generate recommendations. When deployed in that workflow, AI agents would ideally follow the same pattern and make decisions based on the documents they read for contract review and knowledge from other documents. 

“ADW addresses these challenges by treating documents as part of broader business processes,” LlamaIndex said in a blog post. “An ADW system can maintain state across steps, apply business rules, coordinate different components and take actions based on document content — not just analyze it.”  

LlamaIndex has previously said that RAG, while an important technique, remains primitive, particularly for enterprises seeking more robust decision-making capabilities using AI. 

Understanding context for decision making

LlamaIndex has developed reference architectures combining its LlamaCloud parsing capabilities with agents. It “builds systems that can understand context, maintain state and drive multi-step processes.”

To do this, each workflow has a document that acts as an orchestrator. It can direct agents to tap LlamaParse to extract information from data, maintain the state of the document context and process, then retrieve reference material from another knowledge base. From here, the agents can start generating recommendations for the contract review use case or other actionable decisions for different use cases. 

“By maintaining state throughout the process, agents can handle complex multi-step workflows that go beyond simple extraction or matching,” the company said. “This approach allows them to build deep context about the documents they’re processing while coordinating between different system components.”

Differing agent frameworks

Agentic orchestration is an emerging space, and many organizations are still exploring how agents — or multiple agents — work for them. Orchestrating AI agents and applications may become a bigger conversation this year as agents go from single systems to multi-agent ecosystems.

AI agents aree an extension of what RAG offers, that is, the ability to find information grounded on enterprise knowledge. 

But as more enterprises begin deploying AI agents, they also want them to do many of the tasks human employees do. And, for these more complicated use cases, “vanilla” RAG isn’t enough. One of the advanced approaches enterprises have considered is agentic RAG, which expands agents’ knowledge base. Models can decide if they needs to find more information, which tool to use to get that information and if the context it just fetched is relevant, before coming up with a result. 

Related Posts

What Do The Flashing Lights On Your Ego Battery Mean?

In the olden days of disposable batteries, there wasn’t much in the way of efficient power regulation. You just used the batteries until they stopped giving power, and then you…

Read more

What Does SE Stand For On An Apple Watch?

piyaphun phunyammalee/Shutterstock If you’ve been shopping around for an iPhone or Apple Watch, you might have noticed models labeled as “SE” models. Since most of Apple’s flagship models are indicated…

Read more

11 Cool Gadgets To Turn Your Bedroom Into A Zen Den

Runna10/Getty Images Your bedroom should be your sanctuary, a place of restoration that makes it easy to get a good night’s sleep and leave the day’s stresses behind. From calming…

Read more

Can Ryobi Batteries Be Refurbished Or Rebuilt?

Margirita_Puma/Shutterstock Ryobi is one of many tool manufacturers that has gone all-in on battery power. From lawn care equipment to versatile drills and saws, it’s easy for just about anyone…

Read more

Who Owns Mercedes-Benz And Where Are Its Cars Made?

Few brands command as much prestige as Mercedes-Benz — a name synonymous with luxury and performance. From its signature logo to its advanced technology, Mercedes-Benz is widely regarded as a…

Read more

5 Of The Top-Rated Klein Tools For Troubleshooting Circuit Breaker Issues

We may receive a commission on purchases made from links. When undertaking DIY electrical projects at home, safety should always come first. Whether you’re adding a dimmer switch, installing a…

Read more

Leave a Reply