Workflow: Adding New Entries from temp.md
temp.md is the raw input — an unformatted checklist of URLs and short notes. The goal is to produce temp_entries.md as a properly formatted staging file ready to paste into the target section files.
Steps in order:
- Classify each URL → determine which section file (
azure.md, applications.md, models_research.md, best_practices.md, tools_extra.md) and which current section heading it belongs to.
- Fetch descriptions — use
code/fetch_github_description.py for GitHub repos. For arXiv papers and blog/web links, use fetch_webpage to extract a one-sentence description.
- Fetch creation dates — use
code/update_github_dates.py for GitHub repos. For arXiv, derive the date from the ID prefix (e.g., 2602.xxxxx → Feb 2026). For blog posts, read from the page.
- Add star badges — use
code/add_github_stars.py for all GitHub links.
- Apply legend symbols — see the Legend Format section below.
azure.md should not use emoji markers.
- Shorten descriptions — keep each description to ≤15 words. One punchy sentence. Do not repeat the link name.
Legend Format
azure.md — dash-bullet, no emojis
- [Name](url) - Description. (Mon YYYY) 
- Do not use emoji markers in
azure.md (no link-prefix emojis and no description-prefix emojis).
- Date is in
(Mon YYYY) parentheses format with no brackets.
- Star badge goes at the end of the line, after the date.
Examples:
- [Azure ML Prompt Flow](https://learn.microsoft.com/...) - Visual designer for prompt orchestration and evaluation. (Jun 2023)
- [APIM-Sample](https://github.com/Azure-Samples/APIM-Sample) - Single APIM endpoint for multiple models. (Jan 2026) 
applications.md, models_research.md, best_practices.md — numbered list (or dash), symbol appended to link text
1. [Name](url): Description. [Mon YYYY] 
or (for entries that use dash bullets in that section):
- [Name](url): Description. [Mon YYYY]
- The legend symbol is appended inside the link text, immediately after the name (no space before the symbol).
- Date is in
[Mon YYYY] square-bracket format.
- Star badge goes at the end of the line, after the date.
- Use numbered list (
1.) when the surrounding section uses numbered lists; dash (-) when not.
Examples:
1. [Auto-Claude](https://github.com/AndyMik90/Auto-Claude): Autonomous multi-session AI coding. [Dec 2025] 
1. [Towards AI Search Paradigm📑](https://arxiv.org/abs/2506.17188): Modular 4-agent system using DAGs for retrieval-intensive search. [Jun 2025]
- [Claude Code Security](https://www.anthropic.com/news/claude-code-security): Claude Code on the web for scanning codebases. [Feb 2026]
Legend Symbols
| Symbol |
Meaning |
|
Blog post / documentation / web page |
| 📑 |
Academic paper (arXiv) |
| 📺 |
Video content |
| 🤗 |
Hugging Face resource |
Section Reference
Use exact heading names when labeling entries in temp_entries.md. Format: ## <filename> - <Section Name>:.
azure.md
- Azure OpenAI & Foundry Overview
- Orchestration Frameworks
- Prompt Engineering & Tooling
- Agent Frameworks
- Model Training & Inference
- Safety, Security & LLMOps
- Data Processing & Memory
- Dev Tools, MCP & Extensions
- Copilot Product Catalog
- Microsoft Foundry & AI Services
- Azure AI Search
- Agent Development
- Microsoft 365 Agent Development
- Learning Resources & Workshops
- Microsoft Research
- Sample Applications
- Solution Accelerators
- Code Samples & Workshops
- Architecture Patterns & Use Cases
applications.md
- RAG (Retrieval-Augmented Generation)
- GraphRAG
- RAG Application
- Vector Database & Embedding
- Top Agent Frameworks
- Additional Agent Framework
- Cache
- Data & Analytics Agents
- Data Processing & OCR
- Desktop AI assistant
- Memory
- Model Gateway
- Model Serving & Local Runtimes
- Observability & LLMOps
- SDKs, Integration & ML Libraries
- Training & Fine-tuning
- UI & No-Code Tool
- A2A
- Computer use
- Model Context Protocol (MCP)
- Coding
- Deep Research
- Domain-Specific Agents
- Skill
- Harness
Tip: Do not add hand-curated entries to generated index sections such as Popular LLM Applications (GitHub Stars >= 1000); update the generator skill instead.
models_research.md
- Large Language Model Landscape
- Large Language Model Comparison
- Taxonomy of Natural Language Processing
- LLM Evolution and Model Timelines
- NLP Taxonomy and Research Fields
- Large Language Model Collection
- Architecture Comparisons
- Foundation Model Providers
- Domain-Specific and Specialized LLMs
- Multimodal Models
- Prompt Engineering and Visual Prompts
- Prompt Engineering
- Adversarial Prompting
- Prompt Tuner and Optimizer
- Prompt Guides and Prompt Libraries
- Visual Prompting and Visual Grounding
- Large Language Model Training and Optimization
- Pre-training and Data Preparation
- Architecture and Inference Patterns
- Architecture Variants, Attention, and Sparse Computation
- Context and Long-Context Limits
- Tokenization and LLM Numbers
- Capabilities and Evaluation
- Reasoning
- Post-training and Fine-Tuning
- Model Merging and Continual Adaptation
- Parameter-Efficient Fine-Tuning
- LoRA: Low-Rank Adaptation
- Alignment and Preference Optimization
- Quantization Techniques
- Pruning and Sparsification
- Knowledge Distillation
- Memory Optimization
- AI Adoption, Impact, and Society
- AGI, Society, and Long-Term Impact
- Trust, Safety, and Security
- Business Adoption and Use Cases
- Model Roadmaps and Products
- OpenAI Products
- Anthropic AI Products
- Google AI Products
- Survey on Large Language Models
- Additional Topics: A Survey of LLMs
- LLM Research (Ranked by cite count >=150)
- Learning Resources, Implementations, and Regional Materials
- Build LLMs from Scratch
- Japanese and Korean-Language Materials
- General Learning and Supplementary Materials
best_practices.md
- The Problem with RAG
- RAG Solution Design
- Agent Research →
### **Agent Research**
- RAG Research →
### **RAG Research**
- Agent Design Patterns →
### **Agent Design Patterns**
- Tool Use
- Tool Use: LLM to Master APIs
- Proposals & Glossary
tools_extra.md
- LLM for Robotics
- Awesome demo
- Datasets for LLM Training
- Evaluating Large Language Models
- LLM Evalution Benchmarks
- Evaluation Metrics
- LLMOps: Large Language Model Operations
Code Tools Reference
All tools are in code/. Run with python code/<script>.py.
| Script |
Purpose |
fetch_github_description.py |
Fetch GitHub repo descriptions; appends after the link colon. Skips lines that already have a description. |
update_github_dates.py |
Fetch GitHub repo creation date; appends [Mon YYYY] or (Mon YYYY). Skips lines already dated. |
add_github_stars.py |
Append star badge to lines with GitHub links. Skips duplicates. |
fetch_popular_papers.py |
Query Semantic Scholar for review-only RAG/agent paper candidates; not part of normal entry insertion. |
fetch_llm_papers.py |
Generate or refresh the separate LLM-landscape paper pool; use fetch-llm-papers rather than hand-editing its output. |
update_citation_counts.py |
Update citation counts for ranked paper sections via Semantic Scholar. |
check_unused_files.py |
Scan markdown for file refs; move unreferenced files to files/_bak/. |
For arXiv papers and blog posts, fetch_github_description.py does not apply. Use fetch_webpage (agent tool) to retrieve a description from the URL.
Common CLI pattern:
python code/fetch_github_description.py --input temp.md --output temp_with_desc.md
python code/update_github_dates.py --input temp_with_desc.md --in-place
python code/add_github_stars.py --input temp_with_desc.md --in-place
Common Pitfalls (Lessons Learned)
Wrong legend placement: In azure.md, do not use emoji markers at all. In all other files, the symbol is appended to the link name inside [Name]. Never mix these two formats.
Wrong section names: Section labels in temp_entries.md must match the actual heading text in the target file exactly. Check the file before assigning. Do not invent new section names.
Missing descriptions for non-GitHub links: fetch_github_description.py only works for github.com URLs. For arXiv, blog, and product pages, you must fetch the page and write a description manually.
Verbose descriptions: Keep descriptions to ≤15 words. Do not repeat the name. No trailing "for use with", "that helps you", or similar filler.
Date format mismatch: azure.md uses (Mon YYYY) parentheses. All other section files use [Mon YYYY] square brackets.
Emoji preservation: Ensure edits preserve existing legend symbols such as 📑, 📺, and 🤗.
Star badges on non-GitHub links: Only add star badges to github.com links. Blog posts, arXiv papers, and product pages must not have a star badge.
1---2name: add-new-entry-from-temp-md3description: Workflow and tools for adding new entries from temp.md to the section files. Includes legend format, section reference, code tools, and common pitfalls. USE FOR: Adding new resources to the knowledge base. DO NOT USE FOR: Editing existing entries or restructuring sections.4---5
6
7## Workflow: Adding New Entries from temp.md
8
9`temp.md` is the raw input — an unformatted checklist of URLs and short notes. The goal is to produce `temp_entries.md` as a properly formatted staging file ready to paste into the target section files.
10
11**Steps in order:**
12
131. **Classify each URL** → determine which section file (`azure.md`, `applications.md`, `models_research.md`, `best_practices.md`, `tools_extra.md`) and which current section heading it belongs to.
142. **Fetch descriptions** — use `code/fetch_github_description.py` for GitHub repos. For arXiv papers and blog/web links, use `fetch_webpage` to extract a one-sentence description.
153. **Fetch creation dates** — use `code/update_github_dates.py` for GitHub repos. For arXiv, derive the date from the ID prefix (e.g., `2602.xxxxx` → Feb 2026). For blog posts, read from the page.
164. **Add star badges** — use `code/add_github_stars.py` for all GitHub links.
175. **Apply legend symbols** — see the **Legend Format** section below. `azure.md` should not use emoji markers.
186. **Shorten descriptions** — keep each description to ≤15 words. One punchy sentence. Do not repeat the link name.
19
20---
21
22## Legend Format
23
24### `azure.md` — dash-bullet, no emojis
25
26```
27- [Name](url) - Description. (Mon YYYY) 
28```
29
30- Do not use emoji markers in `azure.md` (no link-prefix emojis and no description-prefix emojis).
31- Date is in `(Mon YYYY)` parentheses format with no brackets.
32- Star badge goes at the end of the line, after the date.
33
34**Examples:**
35
36```markdown
37- [Azure ML Prompt Flow](https://learn.microsoft.com/...) - Visual designer for prompt orchestration and evaluation. (Jun 2023)
38- [APIM-Sample](https://github.com/Azure-Samples/APIM-Sample) - Single APIM endpoint for multiple models. (Jan 2026) 
39```
40
41### `applications.md`, `models_research.md`, `best_practices.md` — numbered list (or dash), symbol appended to link text
42
43```
441. [Name](url): Description. [Mon YYYY] 
45```
46or (for entries that use dash bullets in that section):
47```
48- [Name](url): Description. [Mon YYYY]
49```
50
51- The legend symbol is appended **inside the link text**, immediately after the name (no space before the symbol).
52- Date is in `[Mon YYYY]` square-bracket format.
53- Star badge goes at the end of the line, after the date.
54- Use numbered list (`1.`) when the surrounding section uses numbered lists; dash (`-`) when not.
55
56**Examples:**
57
58```markdown
591. [Auto-Claude](https://github.com/AndyMik90/Auto-Claude): Autonomous multi-session AI coding. [Dec 2025] 
601. [Towards AI Search Paradigm📑](https://arxiv.org/abs/2506.17188): Modular 4-agent system using DAGs for retrieval-intensive search. [Jun 2025]
61- [Claude Code Security](https://www.anthropic.com/news/claude-code-security): Claude Code on the web for scanning codebases. [Feb 2026]
62```
63
64### Legend Symbols
65
66| Symbol | Meaning |
67|--------|---------|
68| | Blog post / documentation / web page |
69| 📑 | Academic paper (arXiv) |
70| 📺 | Video content |
71| 🤗 | Hugging Face resource |
72
73---
74
75## Section Reference
76
77Use **exact** heading names when labeling entries in `temp_entries.md`. Format: `## <filename> - <Section Name>:`.
78
79### `azure.md`
80- Azure OpenAI & Foundry Overview
81- Orchestration Frameworks
82- Prompt Engineering & Tooling
83- Agent Frameworks
84- Model Training & Inference
85- Safety, Security & LLMOps
86- Data Processing & Memory
87- Dev Tools, MCP & Extensions
88- Copilot Product Catalog
89- Microsoft Foundry & AI Services
90- Azure AI Search
91- Agent Development
92- Microsoft 365 Agent Development
93- Learning Resources & Workshops
94- Microsoft Research
95- Sample Applications
96- Solution Accelerators
97- Code Samples & Workshops
98- Architecture Patterns & Use Cases
99
100### `applications.md`
101- RAG (Retrieval-Augmented Generation)
102- GraphRAG
103- RAG Application
104- Vector Database & Embedding
105- Top Agent Frameworks
106- Additional Agent Framework
107- Cache
108- Data & Analytics Agents
109- Data Processing & OCR
110- Desktop AI assistant
111- Memory
112- Model Gateway
113- Model Serving & Local Runtimes
114- Observability & LLMOps
115- SDKs, Integration & ML Libraries
116- Training & Fine-tuning
117- UI & No-Code Tool
118- A2A
119- Computer use
120- Model Context Protocol (MCP)
121- Coding
122- Deep Research
123- Domain-Specific Agents
124- Skill
125- Harness
126
127> **Tip:** Do not add hand-curated entries to generated index sections such as `Popular LLM Applications (GitHub Stars >= 1000)`; update the generator skill instead.
128
129### `models_research.md`
130- Large Language Model Landscape
131- Large Language Model Comparison
132- Taxonomy of Natural Language Processing
133- LLM Evolution and Model Timelines
134- NLP Taxonomy and Research Fields
135- Large Language Model Collection
136- Architecture Comparisons
137- Foundation Model Providers
138- Domain-Specific and Specialized LLMs
139- Multimodal Models
140- Prompt Engineering and Visual Prompts
141- Prompt Engineering
142- Adversarial Prompting
143- Prompt Tuner and Optimizer
144- Prompt Guides and Prompt Libraries
145- Visual Prompting and Visual Grounding
146- Large Language Model Training and Optimization
147- Pre-training and Data Preparation
148- Architecture and Inference Patterns
149- Architecture Variants, Attention, and Sparse Computation
150- Context and Long-Context Limits
151- Tokenization and LLM Numbers
152- Capabilities and Evaluation
153- Reasoning
154- Post-training and Fine-Tuning
155- Model Merging and Continual Adaptation
156- Parameter-Efficient Fine-Tuning
157- LoRA: Low-Rank Adaptation
158- Alignment and Preference Optimization
159- Quantization Techniques
160- Pruning and Sparsification
161- Knowledge Distillation
162- Memory Optimization
163- AI Adoption, Impact, and Society
164- AGI, Society, and Long-Term Impact
165- Trust, Safety, and Security
166- Business Adoption and Use Cases
167- Model Roadmaps and Products
168- OpenAI Products
169- Anthropic AI Products
170- Google AI Products
171- Survey on Large Language Models
172- Additional Topics: A Survey of LLMs
173- LLM Research (Ranked by cite count >=150)
174- Learning Resources, Implementations, and Regional Materials
175- Build LLMs from Scratch
176- Japanese and Korean-Language Materials
177- General Learning and Supplementary Materials
178
179### `best_practices.md`
180- The Problem with RAG
181- RAG Solution Design
182- Agent Research → `### **Agent Research**`
183- RAG Research → `### **RAG Research**`
184- Agent Design Patterns → `### **Agent Design Patterns**`
185- Tool Use
186- Tool Use: LLM to Master APIs
187- Proposals & Glossary
188
189### `tools_extra.md`
190- LLM for Robotics
191- Awesome demo
192- Datasets for LLM Training
193- Evaluating Large Language Models
194- LLM Evalution Benchmarks
195- Evaluation Metrics
196- LLMOps: Large Language Model Operations
197
198---
199
200## Code Tools Reference
201
202All tools are in `code/`. Run with `python code/<script>.py`.
203
204| Script | Purpose |
205|--------|---------|
206| `fetch_github_description.py` | Fetch GitHub repo descriptions; appends after the link colon. Skips lines that already have a description. |
207| `update_github_dates.py` | Fetch GitHub repo creation date; appends `[Mon YYYY]` or `(Mon YYYY)`. Skips lines already dated. |
208| `add_github_stars.py` | Append star badge to lines with GitHub links. Skips duplicates. |
209| `fetch_popular_papers.py` | Query Semantic Scholar for review-only RAG/agent paper candidates; not part of normal entry insertion. |
210| `fetch_llm_papers.py` | Generate or refresh the separate LLM-landscape paper pool; use `fetch-llm-papers` rather than hand-editing its output. |
211| `update_citation_counts.py` | Update citation counts for ranked paper sections via Semantic Scholar. |
212| `check_unused_files.py` | Scan markdown for file refs; move unreferenced files to `files/_bak/`. |
213
214**For arXiv papers and blog posts, `fetch_github_description.py` does not apply.** Use `fetch_webpage` (agent tool) to retrieve a description from the URL.
215
216**Common CLI pattern:**
217```powershell
218python code/fetch_github_description.py --input temp.md --output temp_with_desc.md
219python code/update_github_dates.py --input temp_with_desc.md --in-place
220python code/add_github_stars.py --input temp_with_desc.md --in-place
221```
222
223---
224
225## Common Pitfalls (Lessons Learned)
226
2271. **Wrong legend placement:** In `azure.md`, do not use emoji markers at all. In all other files, the symbol is appended to the link name inside `[Name]`. Never mix these two formats.
228
2292. **Wrong section names:** Section labels in `temp_entries.md` must match the actual heading text in the target file exactly. Check the file before assigning. Do not invent new section names.
230
2313. **Missing descriptions for non-GitHub links:** `fetch_github_description.py` only works for `github.com` URLs. For arXiv, blog, and product pages, you must fetch the page and write a description manually.
232
2334. **Verbose descriptions:** Keep descriptions to ≤15 words. Do not repeat the name. No trailing "for use with", "that helps you", or similar filler.
234
2355. **Date format mismatch:** `azure.md` uses `(Mon YYYY)` parentheses. All other section files use `[Mon YYYY]` square brackets.
236
2376. **Emoji preservation:** Ensure edits preserve existing legend symbols such as 📑, 📺, and 🤗.
238
2397. **Star badges on non-GitHub links:** Only add star badges to `github.com` links. Blog posts, arXiv papers, and product pages must not have a star badge.