Building on Dataiku’s transformative Generative AI capabilities introduced in June 2023, the LLM Mesh is envisioned to overcome these roadblocks to enterprise value with LLM Mesh Launch Partners Snowflake, Pinecone, and AI21 Labs.
To address the critical need for an effective, scalable, and secure platform for integrating Large Language Models (LLMs) in the enterprise, Dataiku has unveiled the LLM Mesh. In addition, Dataiku has unveiled Partners Snowflake, Pinecone, and AI21 Labs.
LLM Mesh provides the components companies need to build safe applications using LLMs at scale efficiently. With the LLM Mesh sitting between LLM service providers and end-user applications, companies can choose the most cost-effective models for their needs, both today and tomorrow, ensure the safety of their data and responses, and create reusable components for scalable application development. Dataiku’s new features powering the LLM Mesh will be released in public and private previews starting in October.
Clément Stenac, Chief Technology Officer and co-founder, Dataiku shared, “The LLM Mesh represents a pivotal step in AI. At Dataiku, we’re bridging the gap between the promise and reality of using Generative AI in the enterprise. We believe the LLM Mesh provides the structure and control many have sought, paving the way for safer, faster GenAI deployments that deliver real value.”
Dataiku has also announced LLM Mesh Launch Partners, Snowflake, Pinecone, and AI21 Labs, who represent several of the key components of the LLM Mesh: containerized data and compute capabilities, vector databases, and LLM builders.
With Dataiku, Snowflake is enabling its customers to jointly deploy LLMs on their Snowflake data leveraging containerized compute from Snowpark Container Services within the security perimeter of their Snowflake accounts, all orchestrated by Dataiku to reduce friction and complexity and accelerate business value. Vector databases are new standards, powering AI applications through processes like Retrieval Augmented Generation. Together, Dataiku and Pinecone are setting a new standard, providing a way that others in the industry can align with, helping to overcome barriers the market faces in building enterprise-grade GenAI applications at scale. Pinecone looks forward to collaborating as an LLM Mesh Launch Partner.
AI21 Labs’ collaboration with Dataiku and the LLM Mesh underscores their commitment to this diversity, ensuring enterprises can access a broad spectrum of top-tier, flexible and reliable LLMs.