OpenAI
OpenAI is an AI research and deployment company. Their mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI develops the learning model that powers ChatGPT.
OpenAI and Zilliz
OpenAI provides learning models that convert unstructured data to embeddings and store them in a vector database such as Zilliz Cloud or the open-source Milvus. To help OpenAI users start working with vector data, they partnered with Zilliz to create the OpenAI Cookbook that provides instructions on generating embeddings and storing the data in Milvus.
OpenAI Documentation for Vector Data
Open Source Retrieval Plugins from OpenAI Integrate with Milvus and Zilliz
OpenAI has open sourced retrieval plugins that allow developers to deploy their own plugin and use it with ChatGPT to create a custom knowledge base retrieval solution. The OpenAI embeddings can then be stored in a vector database like Milvus or Zilliz for indexing and searching documents.
Build a Similarity Search with Zilliz Cloud and OpenAI
This step-by-step tutorial showcases OpenAI’s Embedding API with the Zilliz vector database to search across book titles. Many existing book search solutions (such as those used by public libraries, for example) rely on keyword matching rather than a semantic understanding of what the title is actually about. Using a trained model to represent the input data is known as semantic search and can be expanded to a variety of different text-based use cases, including anomaly detection and document search.