mirror of
https://github.com/The-Art-of-Hacking/h4cker
synced 2024-11-24 11:53:02 +00:00
Create vector_databases.md
This commit is contained in:
parent
e19bb09195
commit
196444efc5
1 changed files with 30 additions and 0 deletions
30
ai_research/ML_Fundamentals/vector_databases.md
Normal file
30
ai_research/ML_Fundamentals/vector_databases.md
Normal file
|
@ -0,0 +1,30 @@
|
|||
# Introduction to Vector Databases
|
||||
|
||||
Vector databases are specialized systems designed to store, retrieve, and search high-dimensional vector embeddings efficiently. These databases are crucial for applications that require similarity searches, such as recommendation engines, image recognition, and natural language processing. Unlike traditional databases, vector databases handle complex relationships within data by focusing on vector proximity or similarity rather than exact matches[1][5].
|
||||
|
||||
### Examples of Vector Databases
|
||||
|
||||
1. **[FAISS (Facebook AI Similarity Search)](https://github.com/facebookresearch/faiss)**
|
||||
- FAISS is a high-performance library optimized for dense vector similarity search and clustering. It uses techniques like quantization and partitioning to enhance search efficiency[1].
|
||||
|
||||
2. **[ChromaDB](https://www.trychroma.com/)**
|
||||
- Chroma is an open-source embedding database that facilitates the creation of large language model (LLM) applications by allowing easy management of text documents and similarity searches[2].
|
||||
|
||||
3. **[Pinecone](https://www.pinecone.io/)**
|
||||
- Pinecone is a managed vector database platform designed for high-dimensional data. It offers features like real-time data ingestion and low-latency search, making it suitable for large-scale machine learning applications[2][4].
|
||||
|
||||
4. **[MongoDB Atlas Vector Search](https://www.mongodb.com/products/platform/atlas-vector-search)**
|
||||
- MongoDB Atlas integrates vector search capabilities with its core database, allowing for semantic search and generative AI applications. It provides a specialized vector index that can operate independently of the main database infrastructure[4][5].
|
||||
|
||||
5. **[Weaviate](https://weaviate.io/)**
|
||||
- Weaviate is an open-source vector database that supports various AI applications, offering features like faceted search and integration with existing infrastructures[3].
|
||||
|
||||
6. **[Qdrant](https://qdrant.tech/)**
|
||||
- Qdrant is a simple vector database known for its ease of use and a free-tier option. It is designed to handle vector data efficiently[3].
|
||||
|
||||
7. **[Milvus](https://milvus.io/)**
|
||||
- Milvus is an open-source vector database capable of handling large-scale vector data with low latency, making it suitable for production environments[3].
|
||||
|
||||
These databases provide the infrastructure needed to support advanced AI and machine learning applications by enabling efficient vector storage and retrieval.
|
||||
|
||||
I have several examples of vector databases, RAG, RAG Fusion, RAPTOR, as well as an overview of Searchable Encryption, Homomorphic Encryption, and Multiparty Computation in AI implementations in my blog at https://becomingahacker.org
|
Loading…
Reference in a new issue