LangGraph Studio for Implementing AI Agents: A Hands-on Guide

The importance and usage of agentic AI has grown exponentially since the advent of sophisticated agents such as Autogen, CrewAI, etc. which are able to automate complex tasks, reducing human effort and increasing output. But they require a great deal of management as they can be highly complex in nature with multiple interacting components. The development of such agents requires numerous iterations to refine behavior, integration with specialized tools for better performance and user-friendliness when it comes to development. LangGraph Studio, the latest development from LangChain, is the first AI agent IDE that offers visualization, real-time debugging, iterative development, tool integration and state inspection cum manipulation. This article aims to explain this IDE using a hands-on implementation.   

Table of Contents

1. Understanding LangGraph 
2. LangGraph Implementation Steps
3. Overview of LangGraph Studio 
4. Implementation of LangGraph Studio 

Understanding LangGraph

LangGraph is a framework for building stateful multi-agent applications using LLMs. It combines the concepts of LangChain with DAGs for creating complex and stateful LLM based systems and applications. 

LangGraph’s primary utility is in creating multi-step, multi-agent systems where the information needs to be passed between different components or stages of processing. It is well-suited for applications involving multi-turn conversations, complex decision-making processes and workflow automation. 

LangGraph employs the use of StateGraphs, Nodes, Edges and Agent Executors to implement stateful workflows and allow multi-actor collaboration.

LangGraph Implementation Steps

The following image represents a step-by-step breakdown of LangGraph implementation: 

Overview of LangGraph Studio

LangGraph Studio is the first agent IDE which provides a specialized environment for visualizing, interacting and debugging agent applications. It facilitates the augmentation of development experience with tools tailored for LangGraph applications by providing a comprehensive environment for visualizing and interacting with agent flows. 

LangGraph Studio can be used for visualizing agent graphs, perform interactive debugging of complex agentic applications, real-time interaction with the running agents, modify agent responses mid-execution and use integrated code editing with live updates. 

It integrates seamlessly with LangSmith providing features such as LLM observability and tracing without any manual operation. This integration in turn supports the AI agent developers to understand the structure and working of complex agent graphs. 

The visualization of agent graphs and the ability to edit state enables the developers to better understand agent workflows and iterate faster making it easier to implement quicker iterations on long-running agents. The IDE is positioned as a tool to streamline the development of LLM-powered agentic applications, providing specialized features that traditional code editors don’t provide for this type of development. 

Implementation of LangGraph Studio

Let’s understand the working of LangGraph Studio using a hands-on approach. 

Pre-requisites: 

• LangGraph Studio is in beta and is available to all LangSmith users(free or paid plans). Make sure you have a LangSmith account (https://smith.langchain.com/). 
• Currently it’s is only supported in Apple Silicon Macs. 
• It requires docker-compose (version 2.22.0+ or higher → https://docs.docker.com/compose/release-notes/). Docker Desktop can be installed for getting docker-compose (https://docs.docker.com/desktop/install/mac-install/). Make sure Docker is running before using the LangGraph Studio application. 

Step 1: Download and install LangGraph Studio – 

Use the link to access and download the latest .dmg release of LangGraph Studio (https://github.com/langchain-ai/langgraph-studio/releases). Locate the downloaded .dmg file, open it and drag it to the Applications folder. 

Step 2: Prepare a simple LangGraph agent project – 

A LangGraph agent applications uses the following project structure: 

• .env → File to store the required environment keys for the agent 
• agent.py → Python file for declaring and using the agentic flow 
• langgraph.json → File for configuring LangGraph CLI with the required parameters. 
• requirements.txt → File to store the required dependencies for running the agent project 

Step 3: Populate the files, discussed in Step 2, with the given content/codes and save them – 

.env

OPENAI_API_KEY=<insert your Openai api key here>
TAVILY_API_KEY=<insert your Tavily api key here>

agent.py

from typing import TypedDict, Annotated, Sequence, Literal
from functools import lru_cache
from langchain_core.messages import BaseMessage
from langchain_openai import ChatOpenAI
from langchain_community.tools.tavily_search import TavilySearchResults
from langgraph.prebuilt import ToolNode
from langgraph.graph import StateGraph, END, add_messages

tools = [TavilySearchResults(max_results=1)]

@lru_cache(maxsize=4)
def _get_model(model_name: str):
   if model_name == "openai":
       model = ChatOpenAI(temperature=0, model_name="gpt-4o")
   else:
       raise ValueError(f"Unsupported model type: {model_name}")
   model = model.bind_tools(tools)
   return model
class AgentState(TypedDict):
   messages: Annotated[Sequence[BaseMessage], add_messages]

# Function to determine whether to continue or not
def should_continue(state):
   messages = state["messages"]
   last_message = messages[-1]
   # If there are no tool calls, then finish
   if not last_message.tool_calls:
       return "end"
   # else continue
   else:
       return "continue"
system_prompt = """Be a helpful assistant"""

# Function to call the model
def call_model(state, config):
   messages = state["messages"]
   messages = [{"role": "system", "content": system_prompt}] + messages
   model_name = config.get('configurable', {}).get("model_name", "openai")
   model = _get_model(model_name)
   response = model.invoke(messages)
   return {"messages": [response]}

# Function to execute the tools
tool_node = ToolNode(tools)

# Configuration definition
class GraphConfig(TypedDict):
   model_name: Literal["openai"]

# Defining a new graph
workflow = StateGraph(AgentState, config_schema=GraphConfig)

# Defining the nodes of the graph
workflow.add_node("agent", call_model)
workflow.add_node("action", tool_node)

# Setting the entrypoint as `agent`
workflow.set_entry_point("agent")

# Adding conditional edge 
workflow.add_conditional_edges(

   # Starting node
   "agent",
   # Passing the function which will define the next node to call
   should_continue,
   {
       # If `tools`, then call the tool node.
       "continue": "action",
       # else finish.
       "end": END,
   },
)

# Adding an edge from `tools` to `agent`.
workflow.add_edge("action", "agent")

# Compiling the entire flow to create a LangChain runnable 
graph = workflow.compile()

langgraph.json

{
 "python_version": "3.12",
 "dockerfile_lines": [],
 "dependencies": [
   "."
 ],
 "graphs": {
   "agent": "./agent.py:graph"
 },
 "env": ".env"
}

requirements.txt

langgraph
langchain_core
tavily-python
langchain_community
langchain_openai

Step 4: Open IDE application and select the project containing the files discussed above – 

Step 5: Input and submit a prompt to see the studio in action – 

Step 6: Modify the response and generate new response based on the modification – 

Step 7: Apply interrupts for step-by-step execution – 

Step 8: Use LangSmith WebUI and trace the LLM calls and observe the model performance – 

Final Words

LangGraph Studio marks a significant leap forward in the development of agent-based AI applications. As the first IDE designed specifically for agent development, it addresses unique challenges of working with complex LLM-powered systems. By offering visual graph representation, interactive debugging and real-time agent manipulation, it streamlines the development process for both experienced developers and those new to agent-based systems. 

References

1. Link to the Code Used
2. LangGraph Studio Official Blog
3. LangGraph Studio Git Repo
4. LangGraph Documentation