Empowering Enterprise GenAI Development with New Choreo Features

Choreo is a powerful internal developer platform (IDP) as a service built for enterprises, offering a comprehensive suite of tools for CI/CD, API management, DevOps, observability, and business insights. It provides an all-in-one solution for building, deploying, governing, and monitoring enterprise applications—eliminating the need for developers to build complex CI/CD workflows or set up custom platforms.

With Choreo, enterprises can easily adopt best practices enabling teams to focus on innovation rather than the intricacies of infrastructure management.

Enabling GenAI at Scale

Choreo’s capabilities simplify the transformation of AI scripts into scalable, enterprise-grade solutions, allowing developers to focus more on innovation while minimizing the operational overhead involved in productizing GenAI solutions.

To support GenAI developers and platform teams in maintaining enterprise best practices, Choreo introduced two new features: Choreo-Managed Vector Databases and GenAI API Management. Let’s take a closer look at these features.

Choreo-Managed Vector Databases

Vector databases have become a cornerstone for GenAI applications, powering use cases like semantic retrieval in Retrieval-Augmented Generation (RAG) and serving as long-term memory for chatbots and conversational AI systems.

However, setting up, managing, and securing these databases—especially at scale and cost-effectively—has been a significant challenge for GenAI developers. Choreo addresses this issue by introducing Choreo-Managed Vector Databases, simplifying the process of securely creating and managing vector databases.

Figure 1: Create vector database

With Choreo, you can easily set up PostgreSQL instances to serve both vector database and relational database needs. These databases can be securely shared across your GenAI deployments, ensuring seamless integration and efficient management of vector data.

Users with the appropriate permissions can create and manage these vector databases in their preferred region and with their chosen cloud provider (AWS, Azure, GCP, or DigitalOcean). For detailed instructions on creating these databases, refer to this guide.

Adding to the Marketplace and Securing Access

Figure 2: Database marketplace

Once the database is created, admins can add it to the internal marketplace, making it visible to developers. During this process, admins can:

• Specify credentials to control access
• Define the environments (e.g., production, development) where the database will be accessible

This ensures secure isolation between environments and prevents unauthorized access. For detailed steps, refer to this documentation.

Simplified Developer Access

Developers can connect their projects to these databases without needing direct access to credentials, as Choreo securely injects configuration details as environment variables during deployment. To establish this connection, developers should create a Choreo connection to the database by following this guide.

GenAI API Management

Many GenAI applications rely on external third-party APIs, including those from OpenAI, Anthropic, or Mistral. These APIs are typically usage-based, making it crucial for enterprises to manage access and API keys securely and cost-effectively.

Figure 3: Register GenAI services

To address this, Choreo introduces GenAI Service Dependencies. This feature enables admins to register well-known GenAI APIs such as OpenAI, along with their associated API keys. Once registered, these APIs become available in the internal marketplace, allowing developers to discover and connect to them without needing direct access to the underlying credentials.

Admins maintain control over these dependencies, ensuring that API keys are never exposed to developers. This mitigates the risk of accidental misuse or unauthorized access to costly API services. Similar to vector databases, these APIs can be securely integrated into projects by developers by creating connections to them, further simplifying the process of building GenAI applications at scale.

Conclusion

With the introduction of Managed Vector Databases and GenAI API Management, Choreo continues to position itself as a leading platform for building and scaling enterprise-grade GenAI applications. By enabling organizations to securely manage and consume GenAI resources, Choreo empowers developers to innovate freely while adhering to enterprise best practices.

Unlike other platforms that may offer piecemeal solutions, Choreo delivers a fully integrated experience, enabling enterprises to manage, discover, and consume GenAI resources in a secure and regulated manner. This eliminates the risk of leaking sensitive production credentials while offering a streamlined path to scaling AI-powered solutions.

Sign up for free and see how easy it is to build, scale, and secure your AI-powered applications with Choreo.