Best Practice Report

Layers, Gates, Pipes, And Loops: A GenAI Application Architecture

GenAI Business Applications Require More Than A Large Language Model

November 13th, 2023
Ted Schadler, VP, Principal Analyst
Ted Schadler VP, Principal Analyst
With contributors:
Srividya Sridharan , Martha Bennett , Brandon Purcell , Michele Goetz , Brian Hopkins , Charles Betz , Rowan Curran , Boris Evelson , Anna Synakh , Ian McPherson

Summary

To deploy a genAI-powered business application, you need more than a general-purpose large language model, even one that’s carefully fine-tuned and prompted. To build and safely operate genAI-powered business applications, you need to assemble an architecture that draws on resources from many layers of intelligence; input gates to shape requests and output gates to protect the firm; application pipes to tie it all together though an API-first workflow; and feedback loops to test, monitor, and ensure quality. You can assemble these applications from parts today as you establish a full architecture to support genAI-powered business applications over the next three years.

Want to read the full report?

Contact us to become a client

This report is available for individual purchase ($1495).

Forrester helps business and technology leaders use customer obsession to accelerate growth. That means empowering you to put the customer at the center of everything you do: your leadership strategy, and operations. Becoming a customer-obsessed organization requires change — it requires being bold. We give business and technology leaders the confidence to put bold into action, shaping and guiding how to navigate today's unprecedented change in order to succeed.