Spring AI Playground

Spring AI Playground is a self-hosted web UI designed to simplify AI experimentation, integration, and testing. Provides Java developers with an intuitive interface to experiment with large language models (LLMs), vector databases, and prompt engineering.

Inspired by popular LLM playgrounds, Spring AI Playground leverages the power of Spring AI to support leading AI model providers. It also includes tools for testing retrieval-augmented generation (RAG) workflows and other advanced AI capabilities. The goal is to make AI more accessible to Java developers, helping them quickly prototype and build Spring AI-powered applications.

Quick Start

Build and run the app:

./mvnw clean install
./mvnw spring-boot:run

Open http://localhost:8080 in your browser.

Auto-configurations

Spring AI Playground is configured to use Ollama by default for local LLM and embedding models. No API keys are required, making it easy to get started.

AI Models

To enable Ollama, ensure it is installed and running on your system. Refer to the Spring AI Ollama Chat Prerequisites for setup details.

Support for All Major AI Model Providers

Spring AI Playground supports all major AI model providers, including Anthropic, OpenAI, Microsoft, Amazon, Google, and Ollama. For more details on the available implementations, visit the Spring AI Chat Models Reference Documentation.

Switching to OpenAI

Switching to OpenAI is a primary example of how you can use a different AI model with Spring AI Playground. To explore other models supported by Spring AI, learn more in the Spring AI Documentation.

To switch to OpenAI, follow these steps:

1. Modify the pom.xml file:

   • Remove the Ollama dependency:

     <dependency>
        <groupId>org.springframework.ai</groupId>
        <artifactId>spring-ai-ollama-spring-boot-starter</artifactId>
     </dependency>

   • Add the OpenAI dependency:

     <dependency>
        <groupId>org.springframework.ai</groupId>
        <artifactId>spring-ai-openai-spring-boot-starter</artifactId>
     </dependency>

   2. Update application.yaml:

      • Update the following configuration to set OpenAI as the default profile:

      spring:
        profiles:
          default: openai
        ai:
          openai:
            api-key: your-openai-api-key

Vector Databases

Spring AI Playground offers a comprehensive vector database playground with advanced retrieval capabilities powered by Spring AI's VectorStore API integration.

• Multi-Provider Testing: Switch between vector database providers without code changes
• Syntax Standardization: Query different databases using Spring AI's unified interface

Support for All Major Vector Database Providers

Vector Database providers including Apache Cassandra, Azure Cosmos DB, Azure Vector Search, Chroma, Elasticsearch, GemFire, MariaDB, Milvus, MongoDB Atlas, Neo4j, OpenSearch, Oracle, PostgreSQL/PGVector, Pinecone, Qdrant, Redis, SAP Hana, Typesense and Weaviate.

Vector Databases Playground Features

• Custom Chunk Input: Directly input and chunk custom text for embedding, allowing detailed RAG pipeline testing.
• Document Uploads: Upload files such as PDFs, Word documents, and PowerPoint presentations, and benefit from an end-to-end process of text extraction → chunking → embedding.
• Search and Scoring: Perform vector similarity searches and visualize results with accuracy scores (0-1) for easy evaluation.
• Spring AI Filter Expressions: Utilize metadata-based filtering (e.g., author == 'John' && year >= 2023) to narrow search scopes and refine query results.

These features, combined with Spring AI's flexibility, provide a comprehensive playground for vector database testing and advanced integration into your applications.

Upcoming Features

Here are some features we are planning to develop for future releases of Spring AI Playground:

• RAG Chat (Retrieval-Augmented Generation):
  Improving AI chat by using external data to provide more accurate and relevant responses.

• Observability:
  Introducing tools to track and monitor AI performance, usage, and errors for better management and debugging.

• Authentication:
  Implementing login and security features to control access to the Spring AI Playground.

• Multimodal Support:
  Supporting embedding, image, audio, and moderation models from Spring AI

These features will help make Spring AI Playground even better for testing and building AI projects.