Dataiku’s LLM Mesh enables organizations to securely access and manage multiple LLMs, empowering them to build robust and scalable GenAI applications.
Dataiku, the Universal AI Platform, has announced the expansion of its LLM Mesh ecosystem to facilitate secure access to thousands of large language model (LLM) gateways, empowering data and analytics teams to build and deploy GenAI-driven solutions at scale by adopting a multi-LLM strategy. Dataiku is also closing a critical governance gap to ensure regulatory readiness and effective management of LLM technologies across the organization with the LLM Registry, which allows CIOs and their teams to qualify, document, and rationalize which LLMs should or should not be used across use cases.
In a highly competitive and volatile LLM ecosystem, Dataiku’s LLM Mesh enables organizations to take a multi-LLM approach, easily switching out underlying models to power GenAI-driven applications. With the expansion, the LLM Mesh now supports many LLM players, including 15 major cloud and AI vendors like Amazon Web Services (AWS), Databricks, Google Cloud, Snowflake (Arctic), and more.
“Our goal is to help our customers future-proof their GenAI strategies and avoid obsolescence — that said, we provide a balanced approach to developing AI applications while removing the risk of anchoring a strategy to a single AI provider,” said Florian Douetteau, co-founder and CEO, Dataiku. “The LLM Mesh gives organizations secure access to thousands of diverse models for any GenAI use case they’re looking to implement today for a true multi-LLM strategy.”
Also Read: AI Hype vs. Real-World Impact
LLMs constitute one piece of GenAI applications, and the reality of LLM use in the enterprise is complex as organizations scale to more sophisticated applications. A multi-LLM approach is essential to account for cost and performance management, privacy and security, and to meet regulatory requirements. Dataiku’s Universal AI Platform supports this comprehensive approach, in addition to supporting traditional analytics and machine learning techniques, which allows enterprises to effectively handle the complete development lifecycle of GenAI applications.
“IDC anticipates a future marked by a variety of model types, each suited to different tasks and scenarios,” said Nancy Gohring, IDC senior research director, AI. “Enterprises are likely to use many models of different sizes and modes, and should ensure they can quickly evaluate and swap models as new models come to market and use cases evolve.”
As the industry’s only infrastructure-independent vendor, Dataiku decouples the Generative AI application from the service layer and provides guardrails around cost, usage, hallucinations, PII, and more. This level of choice and flexibility allows Dataiku to expand on its integrations at the pace the ecosystem evolves so that organizations can build and deploy GenAI applications that bring business value instead of augmenting new LLM connections.
