App and Agent

App and Agent

Contents

• RAG (Retrieval-Augmented Generation)
  • Advanced RAG
  • GraphRAG
  • RAG Application
  • Vector Database & Embedding
• AI Application
  • Top Agent Frameworks
  • Orchestration Framework
  • Frameworks / SDKs / Building Blocks
    • Multi-Agent & Swarm Frameworks
    • General Agent Frameworks
    • Official Vendor SDKs
    • Tool Integration & Infrastructure
    • Monitoring, Training & Optimization
    • NLP & ML Libraries
  • Apps / Demos / Ready-to-use Agents
    • General Autonomous Agents
    • Coding & Development
    • Research, Web & Knowledge Tools
    • Productivity & Personal Assistants
    • Data, Finance & Analytics
    • Specialized Agents
  • No Code & User Interface
  • Personal AI assistant & desktop
  • Infrastructure & Backend Services
  • Caching
  • Data Processing
  • Gateway
  • Memory
• Agent Protocol
  • Model Context Protocol (MCP)
  • A2A
  • Computer use
• Coding & Research
  • Coding
  • Skill
  • Domain-Specific Agents
  • Deep Research

RAG (Retrieval-Augmented Generation)

• RAG integrates retrieval (searching) into LLM text generation, enabling models to access external information. ✍️ [25 Aug 2023]
• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks📑: Meta's 2020 framework for giving LLMs access to information beyond training data. [22 May 2020]
  • RAG-sequence — Retrieve k documents to generate all output tokens.
  • RAG-token— Retrieve k documents per token generation.
  • RAG-sequence is the industry standard due to lower cost and simplicity. ✍️ [30 Sep 2023]

Advanced RAG

• 9 Effective Techniques To Boost Retrieval Augmented Generation (RAG) Systems✍️ 🗄️: ReRank, Prompt Compression, Hypothetical Document Embedding (HyDE), Query Rewrite and Expansion, Enhance Data Quality, Optimize Index Structure, Add Metadata, Align Query with Documents, Mixed Retrieval (Hybrid Search) [2 Jan 2024]
• Advanced RAG Patterns: How to improve RAG peformance ✍️ / ✍️ [17 Oct 2023]
  • Data quality: Clean, standardize, deduplicate, segment, annotate, augment, and update data to make it clear, consistent, and context-rich.
  • Embeddings fine-tuning: Fine-tune embeddings to domain specifics, adjust them according to context, and refresh them periodically to capture evolving semantics.
  • Retrieval optimization: Refine chunking, embed metadata, use query routing, multi-vector retrieval, re-ranking, hybrid search, recursive retrieval, query engine, HyDE📑 [20 Dec 2022], and vector search algorithms to improve retrieval efficiency and relevance.
  • Synthesis techniques: Query transformations, prompt templating, prompt conditioning, function calling, and fine-tuning the generator to refine the generation step.
  • HyDE: Implemented in LangChain: HypotheticalDocumentEmbedder✨. A query generates hypothetical documents, which are then embedded and retrieved to provide the most relevant results. query -> generate n hypothetical documents -> documents embedding - (avg of embeddings) -> retrieve -> final result. ✍️
• Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG📑 [15 Jan 2025]
• Azure RAG with Vision Application Framework✨ [Mar 2024]
• Contextual Retrieval✍️: Contextual Retrieval enhances traditional RAG by using Contextual Embeddings and Contextual BM25 to maintain context during retrieval. [19 Sep 2024]
• Demystifying Advanced RAG Pipelines: An LLM-powered advanced RAG pipeline built from scratch ✨ [19 Oct 2023]
• Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAG📑: Ultra High Resolution (UHR) remote sensing imagery, such as satellite imagery and medical imaging. [12 Nov 2024]
• Evaluation with Ragas✍️: UMAP (often used to reduce the dimensionality of embeddings) with Ragas metrics for visualizing RAG results. [Mar 2024] / Ragas provides metrics: Context Precision, Context Relevancy, Context Recall, Faithfulness, Answer Relevance, Answer Semantic Similarity, Answer Correctness, Aspect Critique ✨ [May 2023]
• From Simple to Advanced RAG (LlamaIndex) ✍️ / 🗄️ /💡✍️ [10 Oct 2023]
• How to improve RAG Piplines: LangGraph implementation with Self-RAG, Adaptive-RAG, Corrective RAG. [Oct 2024]
• How to optimize RAG pipeline: Indexing optimization [24 Oct 2023]
• localGPT-Vision✨: an end-to-end vision-based Retrieval-Augmented Generation (RAG) system. [Oct 2024]
• Multi-Modal RAG System✍️: Building a knowledge base with both image and audio data. [12 Feb 2025]
• 🗣️ [7 Nov 2023] OpenAI has put together a pretty good roadmap for building a production RAG system. Naive RAG -> Tune Chunks -> Rerank & Classify -> Prompt Engineering. In llama_index... 📺
• Path-RAG: Knowledge-Guided Key Region Retrieval for Open-ended Pathology Visual Question Answering📑: Using HistoCartography to improve pathology image analysis and boost PathVQA-Open performance. [26 Nov 2024]
• RAG Hallucination Detection Techniques✍️: Hallucination metrics using the DeepEval, G-Eval. [10 Jan 2025] - UniversalRAG✨ [29 Apr 2025]
• VideoRAG📑: Not only does it retrieve relevant videos from a large video corpus, but it also integrates both the visual and textual elements of videos into the answer-generation process using Large Video Language Models (LVLMs). [10 Jan 2025]
• Visual RAG over PDFs with Vespa✍️: a demo showcasing Visual RAG over PDFs using ColPali embeddings in Vespa ✨ [19 Nov 2024]
• What is Agentic RAG: The article published by Weaviate. [5 Nov 2024]

GraphRAG

• Fast GraphRAG✨: 6x cost savings compared to graphrag, with 20% higher accuracy. Combines PageRank and GraphRAG. [Oct 2024]
• FalkorDB✨: Graph Database. Knowledge Graph for LLM (GraphRAG). OpenCypher (query language in Neo4j). [Jul 2023]
• GitNexus✨: Indexes codebases into a knowledge graph and exposes it via MCP tools for AI agents. [Aug 2025]
• Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!📑: using a knowledge graph, the Text-to-SQL accuracy improved from 16% to 54%. [20 May 2024]
• Graph RAG (by NebulaGraph): NebulaGraph proposes the concept of Graph RAG, which is a retrieval enhancement technique based on knowledge graphs. demo [8 Sep 2023]
• GraphRAG (by Microsoft)📑:🏆1. Global search: Original Documents -> Knowledge Graph (Community Summaries generated by LLM) -> Partial Responses -> Final Response. 2. Local Search: Utilizes vector-based search to find the nearest entities and relevant information. ✍️ / ✨ [24 Apr 2024]
  • DRIFT Search✍️: DRIFT search (Dynamic Reasoning and Inference with Flexible Traversal) combines global and local search methods to improve query relevance by generating sub-questions and refining the context using HyDE (Hypothetical Document Embeddings). [31 Oct 2024]
  • "From Local to Global" GraphRAG with Neo4j and LangChain [09 Jul 2024]
  • GraphRAG Implementation with LlamaIndex✨ [15 Jul 2024]
  • Improving global search via dynamic community selection✍️: Dynamic Community Selection narrows the scope by selecting the most relevant communities based on query relevance, utilizing Map-reduce search, reducing costs by 77% without sacrificing output quality [15 Nov 2024]
  • LazyGraphRAG✍️: Reduces costs to 0.1% of full GraphRAG through efficient use of best-first (vector-based) and breadth-first (global search) retrieval and deferred LLM calls [25 Nov 2024]
  • LightRAG✨: Utilizing graph structures for text indexing and retrieval processes. [8 Oct 2024]
  • nano-graphrag✨: A simple, easy-to-hack GraphRAG implementation [Jul 2024]
• Graphiti✨
• GraphSearch✨: An Agentic Workflow for Graph RAG. [Oct 2025]
• HippoRAG✨:💡RAG + Knowledge Graphs + Personalized PageRank. [23 May 2024]
• How to Build a Graph RAG App✍️: Using knowledge graphs and AI to retrieve, filter, and summarize medical journal articles [30 Dec 2024]
• HybridRAG📑: Integrating VectorRAG and GraphRAG with financial earnings call transcripts in Q&A format. [9 Aug 2024]
• Neo4j GraphRAG Package for Python✨ [Feb 2024]

RAG Application

1. AutoRAG✨: RAG AutoML tool for automatically finds an optimal RAG pipeline for your data. [Jan 2024]
2. Canopy✨: open-source RAG framework and context engine built on top of the Pinecone vector database. [Aug 2023]
3. Chonkie✨: RAG chunking library [Nov 2024]
4. Cognita✨: RAG (Retrieval Augmented Generation) Framework for building modular, open-source applications [Jul 2023]
5. Danswer✨: Ask Questions in natural language and get Answers backed by private sources: Slack, GitHub, Confluence, etc. [Apr 2023]
6. Fireplexity✨: AI search engine by Firecrawl's search API [Jun 2025]
7. FlashRAG✨: A Python Toolkit for Efficient RAG Research [Mar 2024]
8. Gemini-Search✨: Perplexity style AI Search engine clone built with Gemini [Jan 2025]
9. Haystack✨: LLM orchestration framework to build customizable, production-ready LLM applications. [5 May 2020]
10. KAG✨: Knowledge Augmented Generation. a logical reasoning and Q&A framework based on the OpenSPG(Semantic-enhanced Programmable Graph). By Ant Group. [Oct 2024]
11. Khoj✨: Open-source, personal AI agents. Cloud or Self-Host, Multiple Interfaces. Python Django based [Aug 2021]
12. kotaemon✨: Open-source clean & customizable RAG UI for chatting with your documents. [Mar 2024]
13. llm-answer-engine✨: Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Mixtral, LangChain, OpenAI, Brave & Serper [Mar 2024]
14. llmware✨: Building Enterprise RAG Pipelines with Small, Specialized Models [Sep 2023]
15. Marqo✨: Tensor search for humans [Aug 2022]
16. MedGraphRAG📑: MedGraphRAG outperforms the previous SOTA model, Medprompt📑, by 1.1%. ✨ [8 Aug 2024]
17. Meilisearch✨: A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications. [Apr 2018]
18. MemFree✨: Hybrid AI Search Engine + AI Page Generator. [Jun 2024]
19. MindSearch✨: An open-source AI Search Engine Framework [Jul 2024]
20. MiniRAG✨: RAG through heterogeneous graph indexing and lightweight topology-enhanced retrieval. [Jan 2025]
21. Morphic✨: An AI-powered search engine with a generative UI [Apr 2024]
22. PageIndex✨: a vectorless, reasoning-based RAG system that builds a hierarchical tree index [Apr 2025]
23. PaperQA2✨: High accuracy RAG for answering questions from scientific documents with citations [Feb 2023]
24. Perplexica✨:💡Open source alternative to Perplexity AI [Apr 2024]
25. PrivateGPT✨: 100% privately, no data leaks. The API is built using FastAPI and follows OpenAI's API scheme. [May 2023]
26. Pyversity✨: A rerank library for search results [Oct 2025]
27. quivr✨: A personal productivity assistant (RAG). Chat with your docs (PDF, CSV, ...) [May 2023]
28. R2R (Reason to Retrieve)✨: Agentic Retrieval-Augmented Generation (RAG) with a RESTful API. [Feb 2024]
29. RAG Builder✨: Automatically create an optimal production-ready Retrieval-Augmented Generation (RAG) setup for your data. [Jun 2024]
30. RAG capabilities of LlamaIndex to QA about SEC 10-K & 10-Q documents✨: A real world full-stack application using LlamaIndex [Sep 2023]
31. RAG-Anything✨: "RAG-Anything: All-in-One RAG System". [Jun 2025]
32. RAGApp✨: Agentic RAG. Custom GPTs, but deployable in your own cloud infrastructure using Docker. [Apr 2024]
33. RAGChecker📑: A Fine-grained Framework For Diagnosing RAG ✨ [15 Aug 2024]
34. RAGflow✨:💡Streamlined RAG workflow. Focusing on Deep document understanding [Dec 2023]
35. RAGFoundry✨: A library designed to improve LLMs ability to use external information by fine-tuning models on specially created RAG-augmented datasets. [5 Aug 2024]
36. RAGLite✨: a Python toolkit for Retrieval-Augmented Generation (RAG) with PostgreSQL or SQLite [Jun 2024]
37. RAGxplorer✨: Visualizing document chunks and the queries in the embedding space. [Jan 2024]
38. Renumics RAG✨: Visualization for a Retrieval-Augmented Generation (RAG) Data [Jan 2024]
39. Scira (Formerly MiniPerplx)✨: A minimalistic AI-powered search engine [Aug 2024]
40. Semantica✨: Semantic intelligence layer that makes your AI agents auditable, explainable, and compliant — beyond Text Similarity [Jun 2025]
41. Semantra✨: Multi-tool for semantic search [Mar 2023]
42. Simba✨: Portable KMS (knowledge management system) designed to integrate seamlessly with any Retrieval-Augmented Generation (RAG) system [Dec 2024]
43. smartrag✨: Deep Research through Multi-Agents, using GraphRAG. [Jun 2024]
44. SWIRL AI Connect✨: SWIRL AI Connect enables you to perform Unified Search and bring in a secure AI Co-Pilot. [Apr 2022]
45. turboseek✨: An AI search engine inspired by Perplexity [May 2024]
46. txtai✨: Semantic search and workflows powered by language models [Aug 2020]
47. Typesense✨: Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch [Jan 2017]
48. UltraRAG✨: A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines [Jan 2025]
49. UniversalRAG✨: RAG framework that retrieves across multiple modalities. [29 Apr 2025]
50. Verba✨: Retrieval Augmented Generation (RAG) chatbot powered by Weaviate [Jul 2023]
51. WeKnora✨: LLM-powered framework for deep document understanding, semantic retrieval, and context-aware answers using RAG paradigm. [Jul 2025]
52. Xyne✨: an AI-first Search & Answer Engine for work. We're an OSS alternative to Glean, Gemini and MS Copilot. [Sep 2024]

Vector Database & Embedding

• A Comprehensive Survey on Vector Database📑: Categorizes search algorithms by their approach, such as hash-based, tree-based, graph-based, and quantization-based. [18 Oct 2023]
• A Gentle Introduction to Word Embedding and Text Vectorization✍️: Word embedding, Text vectorization, One-hot encoding, Bag-of-words, TF-IDF, word2vec, GloVe, FastText. | Tokenizers in Language Models✍️: Stemming, Lemmatization, Byte Pair Encoding (BPE), WordPiece, SentencePiece, Unigram [23 May 2025]
• Azure Open AI Embedding API, text-embedding-ada-002, supports 1536 dimensions. Elastic search, Lucene based engine, supports 1024 dimensions as a max. Open search can insert 16,000 dimensions as a vector storage. Open search is available to use as a vector database with Azure Open AI Embedding API.
• A SQLite extension for efficient vector search, based on Faiss!✨ [Jan 2023]
• Chroma✨: Open-source embedding database [Oct 2022]
• Contextual Document Embedding (CDE)📑: Improve document retrieval by embedding both queries and documents within the context of the broader document corpus. ✍️ [3 Oct 2024]
• Contextualized Chunk Embedding Model✍️: Rather than embedding each chunk separately, a contextualized chunk embedding model uses the whole document to create chunk embeddings that reflect the document's overall context. ✍️ [23 Jul 2025]
• EmbedAnything✨: Built by Rust. Supports BERT, CLIP, Jina, ColPali, ColBERT, ModernBERT, Reranker, Qwen. Mutilmodality. [Mar 2024]
• Embedding Atlas✨: Apple. a tool that provides interactive visualizations for large embeddings. [May 2025]
• Faiss: Facebook AI Similarity Search (Faiss) is a library for efficient similarity search and clustering of dense vectors. It is used as an alternative to a vector database in the development and library of algorithms for a vector database. It is developed by Facebook AI Research. ✨ [Feb 2017]
• FalkorDB✨: Graph Database. Knowledge Graph for LLM (GraphRAG). OpenCypher (query language in Neo4j). For a sparse matrix, the graph can be queried with linear algebra instead of traversal, boosting performance. [Jul 2023]
• Fine-tuning Embeddings for Specific Domains✍️: The guide discusses fine-tuning embeddings for domain-specific tasks using sentence-transformers [1 Oct 2024]
• Is Cosine-Similarity of Embeddings Really About Similarity?📑: Regularization in linear matrix factorization can distort cosine similarity. L2-norm regularization on (1) the product of matrices (like dropout) and (2) individual matrices (like weight decay) may lead to arbitrary similarities. [8 Mar 2024]
• OpenAI Embedding models: text-embedding-3
• lancedb✨: LanceDB's core is written in Rust and is built using Lance, an open-source columnar format. [Feb 2023]
• LEANN✨: The smallest vector database. 97% less storage. [Jun 2025]
• Milvus (A cloud-native vector database) Embedded ✨ [Sep 2019]: Alternative option to replace PineCone and Redis Search in OSS. It offers support for multiple languages, addresses the limitations of RedisSearch, and provides cloud scalability and high reliability with Kubernetes.
• MongoDB's GenAI Showcase✨: Step-by-step Jupyter Notebook examples on how to use MongoDB as a vector database, data store, memory provider [Jan 2024]
• Not All Vector Databases Are Made Equal✍️: Printed version for "Medium" limits. 🗄️ [2 Oct 2021]
• pgvector✨: Open-source vector similarity search for Postgres [Apr 2021] / pgvectorscale✨: 75% cheaper than pinecone [Jul 2023]
• Pinecone: A fully managed cloud Vector Database. Commercial Product [Jan 2021]
• Qdrant✨: Written in Rust. Qdrant (read: quadrant) [May 2020]
• Redis extension for vector search, RedisVL✨: Redis Vector Library (RedisVL) [Nov 2022]
• text-embedding-ada-002✍️: Smaller embedding size. The new embeddings have only 1536 dimensions, one-eighth the size of davinci-001 embeddings, making the new embeddings more cost effective in working with vector databases. [15 Dec 2022]
• The Semantic Galaxy🤗: Visualize embeddings in 3D space, powered by EmbeddingGemma and Transformers.js [Sep 2025]
• Vector Search with OpenAI Embeddings: Lucene Is All You Need📑: For vector search applications, Lucene's HNSW implementation is a resilient and extensible solution with performance comparable to specialized vector databases like FAISS. Our experiments used Lucene 9.5.0, which limits vectors to 1024 dimensions—insufficient for OpenAI's 1536-dimensional embeddings. A fix to make vector dimensions configurable per codec has been merged to Lucene's source here✨ but was not yet released as of August 2023. [29 Aug 2023]
• Weaviate✨: Store both vectors and data objects. [Jan 2021]
• zvec✨: Lightweight vector database by Alibaba Cloud. [Dec 2025]

AI Application

• 900 most popular open source AI tools:🏆What I learned from looking at 900 most popular open source AI tools list [Mar 2024]
• Awesome LLM Apps✨:💡A curated collection of awesome LLM apps built with RAG and AI agents. [Apr 2024]
• Azure OpenAI Samples✨: 🐳 Azure OpenAI (OpenAI) Sample Collection - 🪂 100+ Code Cookbook 🧪 [Mar 2025]
• GenAI Agents✨:🏆Tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. [Sep 2024]
• GenAI Cookbook✨: A mixture of Gen AI cookbook recipes for Gen AI applications. [Nov 2023]
• Generative AI Design Patterns✍️: 9 architecture patterns for working with LLMs. [Feb 2024]
• Open100: Top 100 Open Source achievements.

Agent & Application

Top Agent Frameworks

• AG2✨: Multi-agent conversational framework (formerly AutoGen)
• Agno✨: Agent orchestration framework
• AWS Bedrock Agents✨: AWS-native agent framework
• CrewAI✨: Role-based

…(truncated)