18.3 C
Monday, July 15, 2024

Informatica Unveils New Products and AI Blueprint for Databricks

Must read

Informatica and Databricks expand partnerships to boost GenAI with trusted data and new features. Learn more about GenAI solution blueprint and data integration services.

Informatica, an enterprise cloud data management leader, announced an expanded partnership with Databricks. The partnership, which includes new product capabilities and offerings, brings together the full range of Informatica’s AI-powered Intelligent Data Management Cloud (IDMC) platform capabilities within the Databricks Data Intelligence Platform. The expanded partnership will enable customers to deploy enterprise-grade Generative AI (GenAI) applications at scale based on a foundation of high-quality, trusted data and metadata.

The expanded partnership includes four new capabilities:

  • GenAI Solution Blueprint for Databricks DBRX – Informatica’s GenAI blueprint for Databricks provides a roadmap for customers to develop Retrieval Augmented Generation (RAG)-based GenAI applications using Databricks DBRX. Databricks DBRX is an open, general-purpose large language model (LLM) designed to enable users to develop enterprise-grade GenAI applications. The blueprint allows customers to build RAG-based GenAI solutions, leveraging Informatica’s IDMC no-code/low-code interface, metadata-driven intelligence, and Databricks Vector Database for embedding data, enabling access to trusted and actionable data insights at scale.

Key benefits of the blueprint include:

  • Grounding of generative AI application inferencing and summaries with enterprise data, providing high-fidelity, trusted responses.
  • Enrichment of prompts with comprehensive enterprise data and metadata to contextualize prompts and responses based on the unique industry and organizational semantics.
  • Integrating data quality metrics to prioritize data set selection for grounding will ensure that GenAI applications are based on trusted data.
  • No-code orchestration and definition of RAG chain and agent-based GenAI applications, ensuring customers can rapidly develop, maintain, and scale GenAI applications.
  • Comprehensive data governance is needed to provide transparency and trust in GenAI applications by enforcing data access and using policies to deliver enterprise-compliant applications.
  • Native Databricks SQL ELT – Native SQL ELT will enable users to perform in-database transformations with full pushdown capabilities on Databricks SQL, the intelligent data warehouse, leveraging native Databricks functions, such as the AI-powered Assistant and serverless computing. This will allow customers to develop ETL pipelines to run on Databricks compute for AI-optimized performance, scalable data transformations, and integrations.
  • Cloud Data Integration-Free Service (CDI-Free) on Databricks Partner Connect – Informatica’s CDI-Free offering is now available via Databricks Partner Connect, giving customers quick and easy access to Informatica’s cloud data ingestion and transformation capabilities at no cost. CDI-Free via Partner Connect offers users ELT processing of up to 20 million rows of data or 10 ELT compute hours per month for free.
  • Full IDMC Support via Unity Catalog – The Informatica IDMC platform is now fully validated with Databricks Unity Catalog, a unified governance layer for data and AI within the Databricks platform. The integration with Unity Catalog includes all critical IDMC services and greatly enhances Informatica’s ability to manage data lineage and governance on the IDMC Platform.

“We are excited to expand our innovation and collaboration with Databricks with complete support for Unity Catalog and our enhanced comprehensive GenAI solution blueprint,” said Amit Walia, Chief Executive Officer at Informatica. “Together, we can deliver an AI-powered foundation for data management and data intelligence in the cloud to accelerate our joint customers into the era of GenAI with truly transformative applications.”

Also Read: Explained: Explainable AI

“At KPMG, we are thrilled about the new product offerings and innovations from Informatica and their inclusion in Databricks Partner Connect. This partnership enables us to leverage cutting-edge technologies from both market leaders to drive innovation and deliver tangible business value to our internal IT and the solutions offered to our clients,” said Dennis Tally, Managing Director at KPMG. “With Informatica’s leading AI-powered data management solutions integrated seamlessly into the Databricks ecosystem, we can accelerate our data-driven initiatives, build trusted AI models and unlock actionable insights at scale. We look forward to further collaboration with Informatica and Databricks to drive digital transformation and help our clients thrive in today’s data-driven world.”

“In the era of GenAI, access to trusted, high-quality data is becoming more essential than ever, especially for RAG implementations,” said Adam Conway, SVP of Products at Databricks. “The addition of Informatica’s low-code/no-code CDI-Free solution to Databricks Partner Connect, plus the integration of IDMC with Unity Catalog and new analytical data metadata exploration capabilities for RAG-based GenAI, accelerate access to high-quality data for customers building AI solutions and applications on the Databricks Data Intelligence Platform.”

More articles

Latest posts