Supercharge Spark: Unleashing Big Data Potential with Milvus for RAG systems


meetup.svg

Hybrid Event

Big Data Conference Europe - Session 1

Zilliz's Unstructured Data meetup in SF! Meet people working with unstructured data and enjoy talks from people in the space. 

In-Person Event

SF February Unstructured Data Meetup

Zilliz's Unstructured Data meetup in New York! Meet people working with unstructured data and enjoy talks from people in the space. 

Meet Up

September New York Unstructured Data Meetup

Panel Discussion | Beyond the Hype: Realistic Expectations of AI


Big Data Conference Europe - Session 2

Real-Time AI with Open Source: we will explore the practical reasons for choosing specific indexes, determining what to vectorize, and querying multiple vectors—even when one is an image and the other is text. 


Big Data Conference Europe - Session 3

Exciting evening of insights, networking, and innovation as we explore the cutting-edge world of data infrastructure, graph databases, integration systems, and machine learning!

SF Data for AI Meetup with Zilliz, Fight Health Insurance, Datastrato, Diffbot, & More!

Zilliz's monthly meetup in Berlin! Meet people working with unstructured data and enjoy talks from people in the space. 

November Unstructured Data Meetup Berlin

September Unstructured Data Meetup Berlin

Retrieval Augmented Generation with GPT and Milvus

Key Takeaways:
- Learn how to store text in the Milvus vector database.
- Learn how to use retrieval augmented generation to combine Milvus and GPT.
- Learn how to ask securely questions about business documents

live.svg

Virtual Event

Datacamp Code Along RAG with GPT & Milvus

Zilliz's monthly meetup in San Francisco! Meet people working with unstructured data and enjoy talks from people in the space. 

SF December Unstructured Data Meetup 

Check out our talk on evaluating RAG at the ODSC AI Builders Summit 

Evaluating Retrieval-Augmented Generation and LLM-as-a-Judge Methodologies

Unstructured Data Meetup San Francisco 

Zilliz's Unstructured Data meetup in Sunnyvale! Meet people working with unstructured data and enjoy talks from people in the space. 

Nov Unstructured Data Meetup South Bay Edition

Stephen speaking about Milvus at OSS Europe in Vienna. 

Open Source Summit Europe

Learn how to improve ChatGPT apps by addressing two common issues: incorrect answers due to lack of knowledge, and slow response times due to high query volume. Discover how using a vector database can help you solve both issues allowing you to provide domain-specific knowledge to your LLM application and cache information to speed up follow-up queries. Learn how vector databases can store, query, and retrieve embeddings for similarity searches quickly and at scale. We’ll share free tools to help you build your application for optimal performance and scale immediately! 

Got embeddings? Discover the key to building AI applications that scale

Zilliz's first meetup in Brazil! Meet people working with unstructured data and enjoy talks from people in the space. 

July Unstructured Data Meetup Brazil

Frank Liu's talk at GTC discusses GPU acceleration in Milvus, the world's most widely adopted vector database.  

Generative AI Theater: A GPU-Accelerated Vector Database at NVIDIA GTC

Join us for a hands-on workshop in Palo Alto with Zilliz/Milvus and OpenAI!

Unstructured Data Workshop with Milvus and OpenAI

Details
Developers, mark your calendars for October 25! Join us at our monthly AI for Developers event to dive deep into AI development, machine learning, deep learning, natural language processing, computer vision, AI programming, and AI algorithms.

Discover the power of AI technologies like ChatGPT and Codex to streamline your development process and create innovative solutions.

Don't miss this chance to network with fellow developers, learn about the latest AI trends, and boost your skills in Generative AI development!

Speakers

Patrick McFadin | VP Developer Relations - DataStax
Pietro Schirano | Lead, AI - Brex
Frank Liu | Head of AI & ML - Zilliz
Agenda

6pm: Doors Open
6:30pm: Failure to Plan Is Planning to Fail: Unlocking the Petabyte Vector Store by Patrick McFadin
7pm: Pietro Schirano Presents His Latest Project
7:30pm: Practical RAG - Choosing the Right Embedding Model, Chunking Strategy, and More by Frank Liu
8pm: Community News: Open Mic Announcements
8:05pm: Networking
New Technology


AI For Developers #7

Join Tim to learn about Advanced Retrieval Augmented Generation (RAG) Techniques at ATO 2024!

All Things Open 2024

Topic: Connecting your unstructured data with LLMs

​What we’ll do:
Have some food and refreshments. Hear three exciting talks about LLMs and unstructured data.

​6:00 - 6:30 - Welcome/Networking/Registration
6:30 - 6:50 - Yi Ding, Developer Advocate, LlamaIndex
6:50 - 7:10 - David Garnitz, Founder, VectorFlow
7:10 - 7:30 - Rachel Hu, Founder, CambioML
7:30 - 8:00 - Networking

​Who Should attend:
Anyone interested in talking and learning about Unstructured Data and LLM Apps.

Unstructured Data Meetup SF

This meetups is for people working in unstructured data. Speakers will come present about related topics such as vector databases, LLMs, and managing data at scale. The intended audience of this group includes roles like machine learning engineers, data scientists, data engineers, software engineers, and PMs. This meetup was formerly Milvus Meetup, and is sponsored by Zilliz.

Unstructured Data Meetup San Francisco

Scaling Generative AI solutions with Open-Source and K8s with Stephen Batifol in the AI Room!

CIVO Navigate Europe

The Zilliz team will be exhibiting and speaking at Ai4 in Las Vegas, NV this year. Come say hi!

Ai4 Artificial Intelligence Conference

April Unstructured Data Meetup Berlin

Learn about "Powering Billion Scale Vector Search at Milvus with Apache Pulsar" at Streamnative's Summit in SF!

Data Streaming Summit by Streamnative

May Unstructured Data Meetup Berlin

October Berlin Unstructured Data Meetup

Zilliz's monthly meetup in South Bay Area! Meet people working with unstructured data and enjoy talks from people in the space. 

Unstructured Data Meetup - South Bay Edition 

Zilliz exhibiting and speaking at Confluent Current in Austin, TX! Kafka unlocks Scalable Vector Search in Milvus.

Confluent Current

This webinar host by PingCap brings together experts from TiDB, showcasing their distributed database's upcoming vector search engine, and Milvus, a leader in dedicated vector databases. We'll explore the capabilities and benefits of both vector databases and distributed databases with vector search engine built-in. Zilliz VP of Engineering James Luan will speak on Zilliz Serverless: Slash Your Vector Search Costs by 10x.

Webinar

Navigating AI's Backbone: Choosing Between Vector Databases and Enhanced Distributed Databases

Zilliz's monthly meetup in San Francisco with the AI Alliance! Meet people working with unstructured data and enjoy talks from people in the space. 

September Unstructured Data Meetup San Francisco 

Join Zilliz at ODSC West to learn about Multimodal RAG and stop by our booth!

ODSC West 2024

Get ready for an exciting adventure in app development with Llama 3 - join for a online AI hackathon with Milvus, Together AI, Llama-3 and LlamaIndex


lablab.ai Llama 3 Hackathon

Zilliz's Unstructured Data meetup in Palo Alto! Meet people working with unstructured data and enjoy talks from people in the space. 

June Unstructured Data Meetup South Bay Edition

May Unstructured Data Meetup San Francisco 

​​Join us for an exciting evening of insights, networking, and innovation as we explore the cutting-edge world of data infrastructure and platforming for Generative AI, multimodal models, and beyond.

Data for AI Presents: The Open Source Afterparty w/ MotherDuck, Datastrato, & Zilliz!

August Unstructured Data Meetup South Bay Edition

Craft. Hack. Win big! Connect with Berlin's thriving AI community and transform your ideas into demos

AI Hack Berlin by Zilliz and Google

Join us for SF Tech Week: Data & AI Edition, hosted by BentoML, Datastrato, and Zilliz. This event will focus on the latest developments in AI and data technologies, featuring talks from representatives of each hosting company.

SF #TechWeek Event with BentoML, Datastrato and Zillz

June Unstructured Data Meetup Berlin

Zilliz's Unstructured Data meetup in Redwood City! Meet people working with unstructured data and enjoy talks from people in the space. 

Oct Unstructured Data Meetup South Bay Edition

Build something amazing at the haunted Hacking tech or trat at UNC!  Yujian Tang, Developer Advocate at Zilliz, will be teaching a workshop to help spark your creativity with building the next cool AI application using the open source vector database, Milvus!

Live

HackNC

How NOT to Market to Developers: Lessons from the Trenches


Developer Engagement Summit

Build an exciting project using Milvus or Zilliz for a 4-week online Backdrop Build Hackathon! 

Backdrop Build Hackathon

August New York Unstructured Data Meetup

October New York Unstructured Data Meetup

Zilliz's monthly meetup in Seattle! Meet people working with unstructured data and enjoy talks from people in the space. 

Unstructured Data Meetup Seattle

July Unstructured Data Meetup South Bay Edition

This session is being presented as a part of the [Future of Data Science & AI](https://hubs.la/Q01D9l2W0) virtual conference hosted by Data Science Dojo on March 1-2, 2023.

The total amount of digital data generated worldwide is increasing at a rapid rate. Simultaneously, approximately 80% (and growing) of this newly generated data is unstructured data – data that does not conform to a table- or object-based model. Examples of unstructured data include text, images, protein structures, geospatial information, and IoT data streams. Despite this, the vast majority of companies and organizations do not have a way of storing and analyzing these increasingly large quantities of unstructured data. Embeddings – high-dimensional, dense vectors which represent the semantic content of unstructured data – can remedy this. 

In this tutorial, we’ll introduce embeddings and vector search from both an ML- and application-level perspective. We’ll start with a high-level overview of embeddings and discuss best practices around embedding generation and usage. We’ll then use this knowledge to build two systems: semantic text search and reverse image search. Finally, we’ll see how we can put our application into production using Milvus, the world’s most popular open-source vector database.



Unlock the Power of Embeddings with Vector Search

It's no secret that ChatGPT, the artificial intelligence chatbot from OpenAI, has taken the world by storm and is reinventing how most of us complete everyday tasks. Now that OpenAI has open-sourced retrieval plugins for ChatGPT, allowing anyone to develop their own knowledge base retrieval app, expect to see an explosion of solutions helping people access information at lightning speed.

At the core of these chat solutions, data models transform unstructured data into vector embeddings stored in a vector database. With these embeddings, developers can perform similarity searches to provide the most relevant answers to their users. Join Frank Liu, ML architect at Zilliz, for a session on why vector databases are critical to the success of these LLM-based chat solutions.

How ChatGPT Is Fueling the Need for Specialized Vector Storage

July Unstructured Data Meetup San Francisco 

An online course training with Milvus teaching how to develop “guardrails” to ensure your AI stays on track and delivers trustworthy results.

Training

AI Safety Defenders: Reinforcing Medical Boundaries with Guardrails at NVIDIA GTC

July Unstructured Data Meetup Berlin

June 3 Unstructured Data Meetup San Francisco 

September Unstructured Data Meetup South Bay Edition

August Unstructured Data Meetup San Francisco 

Learn how the integration of the RAPIDS RAFT library significantly enhances Milvus's performance for building indexes and performing search queries. 

Perform High-Efficiency Search, Improve Data Freshness, and Increase Recall With GPU-Accelerated Vector Search and RAG Workflows at NVIDIA GTC

May Unstructured Data Meetup South Bay

Learn about Milvus v2.0 and the groundbreaking functionality developed by the Milvus core team. v2.0 includes feedback from over 1000+ enterprise users and 10,000 community members in order to build a better database to serve enterprises in more AI and big data scenarios.

After gathering this feedback and invaluable use cases, we are pleased to launch Milvus v2.0.

This version has made significant progress in Milvus as a cloud native and distributed system. In this talk, we will introduce the main features, functionality and future prospects of Milvus v2 .0



Introducing Milvus v2.0

The platform has already been adopted in local production by thousands of companies around the world, including Lucidworks, Shutterstock, and Cloudinary. In this webinar, Zilliz engineers will highlight the changes and features included with Milvus 2.0, a variety of use cases and applications in production—and how they empower small and large users alike.


Milvus 2.0, an open-source similarity search engine

November Unstructured Data Meetup San Francisco 

"It’s in the Air Tonight. Sensor Data in RAG" - Tim will be speaking at Voxel 51's AI, Machine Learning and Computer Vision Meetup


AI, Machine Learning and Computer Vision Meetup

Join us at Zoom HQ in San Jose for the second event in our developer meetup series! Frank will be speaking from Zilliz.

AI & Tech Talks @ Zoom HQ

ChatGPT, the artificial intelligence chatbot from OpenAI, has taken the world by storm and has transformed the way we perform everyday tasks. With its advanced language processing capabilities, it has become a go-to solution for people looking for quick answers, whether it's about the weather, the news, or how to cook a recipe. 

New open source plugins have made it possible for developers to easily build their own ChatGPT knowledge base solutions. At the heart of these solutions is a data model that converts unstructured data from text, videos, images and more into vector embeddings. 

Vector databases are designed to efficiently store and retrieve these high-dimensional embeddings, making them an ideal solution for chat applications that require fast and accurate vector search results. Join Frank Liu, ML architect at Zilliz, for a session on why vector databases are critical to the success of these LLM-based chat solutions and how developers can build powerful chat solutions that deliver quick answers.

In this session, you'll learn:

- What is a vector database
- Why is it important to store your embeddings in a purpose-built database
- Why dumping your embeddings into Postgres is a bad idea
- How we built a chat knowledge base for open-source projects using Zilliz, prompts-as-code, and ChatGPT

The Rising Demand for Vector Databases in the Age of ChatGPT

We are meeting for our first happy hour/discussion group about Unstructured Data and its future in machine learning and LLM apps! This month's topic: Connecting your unstructured data with LLMs


Unstructured Data Meetup - June

Join us at the LLMs in Production virtual conference by MLOps on the 15th-16th of June. Our very own Yujian Tang will be speaking about "Solving LLM Data Problems" on Friday, June 16th at 12pm Pacific. Register free to join us! 

LLMs in Production - Part II

Join the Zilliz team at the AI Conference for two days of captivating talks, interactive workshops, and dynamic networking opportunities. 

AI Conference

To educate IT leaders and database professionals about the newest technologies and strategies paving the way in the cloud and AI era, DBTA is holding a special roundtable webinar on July 18th.

New Database Technologies and Strategies in the Cloud and AI Era

Data Science Connect’s COLLIDE Data Science Conference will showcase the latest trends and advancements in data-driven decision making and how it is revolutionizing industries such as healthcare, finance, and marketing.

COLLIDE Data Conference 2023

Discover the game-changing role of vector databases in computer vision applications at this Computer Vision virtual meetup.

July Virtual Computer Vision Meetup (Hosted by Voxel51)

Come together with cloud enthusiasts from around the world to hear the latest cloud industry innovations, meet with AWS experts, have fun, and build connections.

AWS re:Invent 2023

Join us for an exciting hands-on workshop co-hosted by Arize Phoenix and Milvus, where we will delve into the world of querying using cutting-edge technologies like Arize Phoenix, LlamaIndex, LangChain, GPT 3.5 Turbo, NLTK, and Milvus. This workshop is designed for developers and enterprises seeking to apply large language models to common use cases.

Building And Troubleshooting An Advanced LLM Query Engine

Zilliz will be onsite at Innovation Alley at this year's Transform 2023 conference hosted by VentureBeat.

Transform 2023

Three amazing talks:

​Eric Peter at Databricks will talk about his experimentation leading to creating a benchmark for RAGs.

​Christy Bergman at Zilliz will talk about pain points and lessons learned building OSSChat, a conversational AI chat app on GitHub docs

​Mark Huang at Gradient talking on scalable architectures about "The Next Million AI Systems"

6th MLOps Community SF Meetup (In-Person)

Build something amazing at the 10th anniversary of CalHacks!  Christy Bergman, Developer Advocate at Zilliz, will be teaching a workshop to help spark your creativity with building the next cool AI application using the open source vector database, Milvus!

CalHacks

This hackathon invites women technologists to explore and build Retrieval-Augmented Generation using open-source vector database technology.

Women in AI RAG Hackathon @ Stanford

Discover how Milvus 2.6 slashes AI infrastructure costs while boosting performance

James Luan

Introducing Milvus 2.6: Scalable AI at Lower Costs with James Luan, VP of Engineering at Zilliz

Join our monthly demo for a technical overview of Zilliz Cloud, a highly scalable and performant vector database service for AI applications.

Rohit Nijhawan

Monthly Product Demo: Discover the Power of Zilliz Cloud

Discover how to build powerful, language-agnostic vector database applications using ONNX with Milvus.

Stefan Webb

No Python? No Problem. Vector Database Applications with Milvus + ONNX Across Languages

Jay Byoun

Learn how to integrate Feast with Milvus to support vector-based retrieval in RAG systems 


Francisco Javier Arceo

Smarter RAG Pipelines: Scaling Search with Milvus and Feast

Extract docs with Crawl4AI, then use Milvus' full text & vector search to achieve precise document retrieval.

Erbli Kuka

Milvus Hybrid Search: Combining Keyword Precision with Semantic Power for Next-Gen Data Retrieval

Discover how to integrate Vision Language Models with Browser Use and Milvus to create an agentic system capable of real-time visual and textual analysis.

Stephen Batifol is a Developer Advocate at Zilliz.

Stephen Batifol

Agentic AI in Action: Real-Time Vision, Memory & Autonomy with Browser Use & Milvus

We will examine the concepts underpinning modern agents using our basic clone, Deep Searcher, as an example.


What Makes "Deep Research"? A Dive into AI Agents

We'll explore the architecture that makes it possible to run a Multimodal RAG System and demonstrate how to build one using Milvus, LlamaIndex, and vLLM for deploying open-source LLMs on your infrastructure. 


Deploying a Multimodal RAG System Using Open Source Milvus, LlamaIndex, and vLLM

Ameek Singh

Build a simple AI agent with advanced multimodal RAG capabilities using Friendli Serverless Endpoints and Milvus DB.

Soomin Chun

Accelerate AI Agents with Multimodal RAG powered by Friendli Endpoints and Milvus

We'll explore how new multimodal foundation models are trained to understand tabular data and demonstrate practical ways to unlock hidden value in your organization's data assets.


A Table is Worth 1000 Words

This presentation delves into the cutting-edge landscape of foundation models for time-series analysis. 

Foundation Models for Time-Series

Overcome the ambiguity of current embedding model evaluation approaches through TDA clustering on your dataset!

Gabriel Alon

Gunnar Carlsson

How to Optimize Your Embedding Model Selection and Development through TDA Clustering 

In this hands-on workshop, you'll learn how to implement powerful hybrid search solutions with just raw text input. 


Hands-On Workshop: Build Hybrid Search Apps with Milvus 2.5

Dive into the use of Milvus as a high-performance vector database tailored for handling large-scale document collections, focusing on European Commission and Parliament acts.

Alessandro Saccoia

Vector Databases for Enhanced Classification

This talk will share insights into building image-text search and Composite Image Retrieval (CIR) using multimodal embeddings and the Milvus open source vector database

Multimodal Retrieval-Augmented Generation (RAG) with Vector Database

​Sneak Peak of Milvus 2.5 - Quick look at our BM25 implementation and sparse vector optimizations


Dense Embeddings != Complete Search - A Sneak Peek of Milvus 2.5

Learn how to manage and control access to data in vector databases, especially when dealing with sensitive information in enterprise settings


Events

Upcoming Events

Webinar

Introducing Milvus 2.6: Scalable AI at Lower Costs with James Luan, VP of Engineering at Zilliz

Join the Milvus Discord Community

Past Events