Most Popular LLM Orchestration Frameworks

While a lot of people are developing apps directly with the APIs like Gemini and OpenAI, there are a number of tools now popular and put into production which look to make it easier to build apps with LLMs. There’s a range of features available - integrations with 3rd parties, monitoring/tracing and logging, evaluations, security and storing prompts as separate files (prompts as code)

In this article, we explore some of the most popular frameworks - if you think we’re missing anything, or you think of other measures that we can use to measure the popularity - start a discussion on Github!