LlamaIndex goes beyond RAG so agents can make complex decisions

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Popular AI orchestration framework LlamaIndex has introduced Agent Document Workflow (ADW) a new architecture that the company says goes beyond retrieval-augmented generation (RAG) processes and increases agent productivity. 

As orchestration frameworks continue to improve, this method could offer organizations an option for enhancing agents’ decision-making capabilities. 

LlamaIndex says ADW can help agents manage “complex workflows beyond simple extraction or matching.”

Some agentic frameworks are based on RAG systems, which provide agents the information they need to complete tasks. However, this method does not allow agents to make decisions based on this information. 

LlamaIndex gave some real-world examples of how ADW would work well. For instance, in contract reviews, human analysts must extract key information, cross-reference regulatory requirements, identify potential risks and generate recommendations. When deployed in that workflow, AI agents would ideally follow the same pattern and make decisions based on the documents they read for contract review and knowledge from other documents. 

“ADW addresses these challenges by treating documents as part of broader business processes,” LlamaIndex said in a blog post. “An ADW system can maintain state across steps, apply business rules, coordinate different components and take actions based on document content — not just analyze it.”  

LlamaIndex has previously said that RAG, while an important technique, remains primitive, particularly for enterprises seeking more robust decision-making capabilities using AI. 

Understanding context for decision making

LlamaIndex has developed reference architectures combining its LlamaCloud parsing capabilities with agents. It “builds systems that can understand context, maintain state and drive multi-step processes.”

To do this, each workflow has a document that acts as an orchestrator. It can direct agents to tap LlamaParse to extract information from data, maintain the state of the document context and process, then retrieve reference material from another knowledge base. From here, the agents can start generating recommendations for the contract review use case or other actionable decisions for different use cases. 

“By maintaining state throughout the process, agents can handle complex multi-step workflows that go beyond simple extraction or matching,” the company said. “This approach allows them to build deep context about the documents they’re processing while coordinating between different system components.”

Differing agent frameworks

Agentic orchestration is an emerging space, and many organizations are still exploring how agents — or multiple agents — work for them. Orchestrating AI agents and applications may become a bigger conversation this year as agents go from single systems to multi-agent ecosystems.

AI agents aree an extension of what RAG offers, that is, the ability to find information grounded on enterprise knowledge. 

But as more enterprises begin deploying AI agents, they also want them to do many of the tasks human employees do. And, for these more complicated use cases, “vanilla” RAG isn’t enough. One of the advanced approaches enterprises have considered is agentic RAG, which expands agents’ knowledge base. Models can decide if they needs to find more information, which tool to use to get that information and if the context it just fetched is relevant, before coming up with a result. 

Related Posts

The Collapse of USAID Is Fueling Human Trafficking and Slavery at Scammer Compounds

As Elon Musk’s DOGE team continues to rampage through United States federal agencies, Trump administration efforts to eliminate the United States Agency for International Development (USAID) seem to be furthest…

Read more

Can You Use Your Samsung Galaxy Buds As Hearing Aids?

For those who are hard of hearing or struggle with hearing loss, hearing aids are a lifeline to the world, enabling users to navigate the commotion of everyday life. But…

Read more

The Far Right Has a New Hero: Elon Musk

Elon Musk has overtaken President Donald Trump as the hero of America’s far-right movement. A WIRED review of message boards, encrypted channels, social media platforms, online search trends, and public…

Read more

LinkedIn Is Testing an AI Tool That Could Transform How People Search for Jobs

LinkedIn is testing a new job-hunting tool that uses a custom large language model to comb through huge quantities of data to help people find prospective roles. The company believes…

Read more

4 Signature Pontiac Design Features That Defined The Brand

Fpg/Getty Images Pontiac has long been a brand that has set itself apart through the distinctive design of many of its cars. For much of its history, going back as far…

Read more

Amazon is holding a devices event on February 26

Amazon is set to show off some new stuff later this month. The company has scheduled a devices event for February 26 in New York City. The company’s hardware chief,…

Read more

Leave a Reply