Dataiku, known as the platform for Everyday AI, has unveiled the LLM Mesh, addressing the pressing need for an efficient, scalable, and secure platform for integrating Large Language Models (LLMs) into enterprise operations. Moreover, Dataiku is pleased to introduce its LLM Mesh Launch Partners: Snowflake, Pinecone, and AI21 Labs, who join in this announcement.
While Generative AI offers numerous opportunities and advantages for businesses, it comes with its fair share of challenges. These include the absence of a centralized administration, insufficient permission controls for data and models, limited safeguards against harmful content, the utilization of personally identifiable information, and a lack of mechanisms for monitoring costs. Furthermore, many organizations require guidance in establishing best practices to fully harness the potential of this emerging technological landscape.
Expanding upon Dataiku’s groundbreaking Generative AI capabilities introduced in June 2023, the LLM Mesh aims to overcome these obstacles to maximize enterprise value.
LLM Mesh: The Fundamental Infrastructure for Gen AI Applications
The LLM Mesh provides businesses with the necessary components to develop secure applications using LLMs at scale efficiently. By positioning the LLM Mesh between LLM service providers and end-user applications, companies can select the most cost-effective models for their current and future needs, ensuring data and responses remain secure, and creating reusable components for scalable application development.
Key elements of the LLM Mesh include universal AI service routing, secure access and auditing for AI services, provisions for screening private data and moderating responses, as well as performance and cost monitoring. Additionally, the LLM Mesh offers standardized components for application development, guaranteeing quality, consistency, and the level of control and performance expected by businesses.
Dataiku’s new features powering the LLM Mesh will be made available for public and private previews starting in October.
Clément Stenac, Chief Technology Officer and co-founder at Dataiku, commented, “The LLM Mesh represents a pivotal advancement in AI. At Dataiku, we are bridging the gap between the promise and reality of leveraging Generative AI in the enterprise. We believe the LLM Mesh provides the structure and control that many have been seeking, paving the way for safer, faster GenAI deployments that deliver tangible value.”
Introducing the Dataiku LLM Mesh Launch Partners
Dataiku strives to enable the effective and comprehensive use of LLMs, vector databases, and diverse compute infrastructures in the enterprise, while also working to complement existing providers. This approach aligns with Dataiku’s overarching philosophy of enhancing, rather than duplicating, the capabilities of existing technologies and making them accessible to all. Dataiku proudly announces its LLM Mesh Launch Partners: Snowflake, Pinecone, and AI21 Labs, each representing essential components of the LLM Mesh, including containerized data and compute capabilities, vector databases, and LLM builders.
Torsten Grabs, Senior Director of Product Management at Snowflake, expressed, “We are enthusiastic about the vision of the LLM Mesh because we understand that the real value lies not only in deploying LLM-powered applications but also in democratizing AI in a secure and reliable manner. With Dataiku, we empower our mutual customers to deploy LLMs on their Snowflake data using containerized compute from Snowpark Container Services within the security confines of their Snowflake accounts. Dataiku orchestrates this process to reduce friction and complexity, accelerating business value.”
Chuck Fontana, VP of Business Development at Pinecone, added, “The LLM Mesh is not just an architectural concept; it represents a path forward. Vector databases set new standards, fueling AI applications through innovations like Retrieval Augmented Generation. Together, Dataiku and Pinecone are establishing a new benchmark, providing a framework for others in the industry to follow. This collaboration helps address the challenges faced in building enterprise-grade GenAI applications at scale, and Pinecone eagerly anticipates its role as an LLM Mesh Launch Partner.”
Pankaj Dugar, SVP and GM, North America at AI21 Labs, emphasized, “In today’s ever-evolving technological landscape, fostering a diverse and tightly integrated ecosystem within the Generative AI stack is of paramount importance for the benefit of our customers. Our collaboration with Dataiku and the LLM Mesh underscores our commitment to diversity, ensuring enterprises can access a wide array of top-tier, flexible, and dependable LLMs. We firmly believe that diversity fuels innovation, and with Dataiku’s LLM Mesh, we are stepping into a future filled with limitless AI possibilities.”
