feat: 4 new search providers — Tavily, Google CSE, Wikipedia, Wikidata

- Added Tavily AI-optimized search (POST API, AI summary, 1,000/mo free)
- Added Google Custom Search Engine (GET API, key:cx format, 100/day free)
- Added Wikipedia API (free, MediaWiki action=query, HTML-stripped snippets)
- Added Wikidata API (free, wbsearchentities, structured knowledge)
- Added API_KEY_TAVILY and API_KEY_GOOGLE_CSE storage keys
- Updated dropdowns in ai-docgen.js (3 locations), modal-templates.js, help-mode.js
- Wikipedia/Wikidata skip API key prompt (free providers)

Author: ijbo

README.md

@@ -39,7 +39,7 @@
 | **AI Document Tags** | `{{@AI:}}` text generation, `{{@Think:}}` deep reasoning, `{{@Image:}}` image generation (Gemini Imagen), `{{@OCR:}}` image-to-text extraction (Text/Math/Table modes via Granite Docling 258M or Florence-2 230M, PDF page rendering via pdf.js), `{{@TTS:}}` text-to-speech playback (Kokoro TTS per card, language selector, ▶ Play / ⬇ Save WAV), `{{@STT:}}` speech-to-text dictation (engine selector: Whisper/Voxtral/Web Speech API, 11 languages, Record/Stop/Insert/Clear), `{{@Translate:}}` translation (target language selector, integrated TTS pronunciation, cloud model routing), `{{@Game:}}` game builder (AI-generated or pre-built, Canvas 2D/Three.js/P5.js, import/export HTML) — `@` prefix syntax on all tag types + metadata fields (`@name`, `@use`, `@think`, `@search`, `@prompt`, `@step`, `@upload`, `@model`, `@engine`, `@lang`, `@prebuilt`); `@model:` field persists selected model per card with intelligent defaults (OCR→`granite-docling`, TTS→`kokoro-tts`, STT→`voxtral-stt`, Image→`imagen-ultra`); editable `@prompt:` textarea and `@step:` inputs in preview cards; description/prompt separation (bare text = label, `@prompt:` = AI instruction); 📎 image/PDF upload for multimodal vision analysis; per-card model selector with document-portable model persistence, concurrent block operations |
 | **🔌 API Calls** | `{{API:}}` REST API integration — GET/POST/PUT/DELETE methods, custom headers, JSON body, response stored in `$(api_varName)` variables; inline review panel; toolbar GET/POST buttons |
 | **🔗 Agent Flow** | `{{Agent:}}` multi-step pipeline — define Step 1/2/3, chain outputs, per-card model + search provider selector, live step status indicators (⏳/✅/❌), review combined output |
-| **🔍 Web Search** | Toggle web search for AI — DuckDuckGo (free), Brave Search, Serper.dev; search results injected into LLM context; source citations in responses; per-agent-card search provider selector |
+| **🔍 Web Search** | Toggle web search for AI — 7 providers: DuckDuckGo (free), Brave Search, Serper.dev, Tavily (AI-optimized), Google CSE, Wikipedia, Wikidata; search results injected into LLM context; source citations in responses; per-agent-card search provider selector |
 | **🎮 Game Builder** | `{{@Game:}}` tag — AI-generated games (Canvas 2D / Three.js / P5.js) or instant pre-built games via `@prebuilt:` field (chess, snake, shooter, pong, breakout, maths quiz); engine selector pills; per-card model picker; 📋 Import button for pasting/uploading external HTML game code with source viewer; 📥 Export as standalone HTML; ⛶ fullscreen; single-line field parsing; "Games for Kids" template with 6 playable games |
 | **🐧 Linux Terminal** | `{{Linux:}}` tag — two modes: (1) Terminal mode opens full Debian Linux ([WebVM](https://webvm.io)) in new window with `Packages:` field; (2) Compile & Run mode (`Language:` + `Script:`) compiles/executes 25+ languages (C++, Rust, Go, Java, Python, TypeScript, Kotlin, Scala…) via [Judge0 CE](https://ce.judge0.com) with inline output, execution time & memory stats |
 | **❓ Help Mode** | Interactive learning mode — click ❓ Help to highlight all buttons, click any button for description + keyboard shortcut + animated demo video; 50% screen demo panel with fullscreen expand; 16 dedicated demo videos mapped to every toolbar button |
@@ -459,6 +459,7 @@ TextAgent has undergone significant evolution since its inception. What started
 
 | Date | Commits | Feature / Update |
 |------|---------|-----------------|
+| **2026-03-13** | | 🔍 **4 New Search Providers** — added Tavily (AI-optimized, returns clean summarized results for LLM injection, 1,000/mo free), Google Custom Search Engine (official Google results, 100/day free), Wikipedia API (free encyclopedia search), and Wikidata API (free structured knowledge); total providers now 7; updated all dropdown selectors (AI panel, AI cards, Agent cards); Wikipedia/Wikidata skip API key prompt |
 | **2026-03-13** | | 🔍 **Search thinking block** — web search results now appear in a collapsible "thinking" `<details>` block *before* the AI response streams; two-phase UX: spinner appears instantly when search starts, populates with results (or "no results") when complete; source citation pills below; removed duplicate inline search details from AI response bubbles; fixed duplicate user message bug in `sendToAi()` dedup check |
 | **2026-03-13** | | 📐 **LaTeX coding block** — new `📐 LaTeX` toolbar button in Coding dropdown inserts `$$...$$` display math blocks; default template `\frac{\sqrt{2025} + \sqrt{3025}}{\sqrt{25}}` evaluates to 20 via Nerdamer; MathJax renders in preview; Playwright test added |
 | **2026-03-13** | | 🐛 **Run All output fix** — `▶ Run All` now renders output for every block (bash, JS, SQL, math); fixed `findBlockContainer` producing wrong CSS selectors for bash/JS containers; added `renderBlockOutput()` for DOM rendering during Run All; SQL default template changed to `CREATE TABLE IF NOT EXISTS` for idempotent re-runs; math default template now pre-assigns `x = 5` before `x^2 + 2*x + 1` |

changelogs/CHANGELOG-search-providers.md

@@ -0,0 +1,56 @@
+# Search Providers — Tavily, Google CSE, Wikipedia, Wikidata
+
+- Added Tavily search provider (AI-optimized, POST API, `include_answer` for AI summary, 1,000/month free)
+- Added Google Custom Search Engine (CSE) provider (GET API, key:cx format, 100/day free, 429 quota error handling)
+- Added Wikipedia API provider (free, no API key, MediaWiki `action=query` search with HTML tag stripping)
+- Added Wikidata API provider (free, no API key, `wbsearchentities` endpoint for structured knowledge)
+- Added `API_KEY_TAVILY` and `API_KEY_GOOGLE_CSE` localStorage key constants to `storage-keys.js`
+- Updated search provider dropdowns in 3 locations in `ai-docgen.js` (Agent card, AI card, generic)
+- Updated AI panel search provider dropdown in `modal-templates.js` with 4 new options
+- Updated API key prompt guard to skip key modal for `wikipedia` and `wikidata` (free providers)
+- Updated Agent Flow help description in `help-mode.js` to list all 7 providers
+
+---
+
+## Summary
+
+Expands the web search system from 3 providers (DuckDuckGo, Brave, Serper) to 7 by adding Tavily (AI-optimized results with AI summary), Google Custom Search Engine (official Google results), Wikipedia (free encyclopedia search), and Wikidata (structured knowledge base). All search functions follow the existing `{title, url, snippet}` result format. Wikipedia and Wikidata are free with no API key; Tavily and Google CSE require keys stored via the existing API key modal.
+
+---
+
+## 1. Search Engine Core — 4 New Provider Functions
+**Files:** `js/ai-web-search.js`
+**What:** Added 4 provider config objects to `PROVIDERS` and 4 `async` search functions: `searchTavily()` (POST to `api.tavily.com/search` with `include_answer: true`), `searchGoogleCSE()` (GET to `googleapis.com/customsearch/v1` with `key:cx` splitting), `searchWikipedia()` (GET to `en.wikipedia.org/w/api.php` with HTML tag stripping from snippets), `searchWikidata()` (GET to `wikidata.org/w/api.php` with `wbsearchentities`). Updated `performSearch()` switch with 4 new cases.
+**Impact:** 7 search providers now available. Tavily is recommended for AI agents — it returns clean, summarized results optimized for LLM context injection.
+
+## 2. Storage Keys
+**Files:** `js/storage-keys.js`
+**What:** Added `API_KEY_TAVILY: 'md-viewer-tavily-api-key'` and `API_KEY_GOOGLE_CSE: 'md-viewer-google-cse-key'` constants.
+**Impact:** API keys for Tavily and Google CSE persist in localStorage following the existing pattern.
+
+## 3. Dropdown Options — 3 Locations
+**Files:** `js/ai-docgen.js`
+**What:** Added 4 new `<option>` entries (🤖 Tavily, 🔍 Google CSE, 📖 Wikipedia, 📊 Wikidata) to Agent card search dropdown (~line 548), AI card search dropdown (~line 799), and updated the API key prompt guard (~line 1818) to skip key prompts for `wikipedia` and `wikidata`.
+**Impact:** Users can select the new providers from any AI or Agent card in the preview.
+
+## 4. AI Panel Provider Bar
+**Files:** `js/modal-templates.js`
+**What:** Added 4 new `<option>` entries to `#ai-search-provider-select` dropdown.
+**Impact:** New providers appear in the global AI panel search selector.
+
+## 5. Help Text
+**Files:** `js/help-mode.js`
+**What:** Updated Agent Flow help description to list all 7 providers.
+**Impact:** Help mode accurately documents available search providers.
+
+---
+
+## Files Changed (5 total)
+
+| File | Lines Changed | Type |
+|------|:---:|------|
+| `js/ai-web-search.js` | +185 −2 | 4 new provider configs + search functions |
+| `js/storage-keys.js` | +2 −0 | Tavily + Google CSE key constants |
+| `js/ai-docgen.js` | +9 −3 | 4 new options in 3 dropdowns + key guard |
+| `js/modal-templates.js` | +4 −0 | AI panel dropdown options |
+| `js/help-mode.js` | +1 −1 | Help text update |

js/ai-docgen.js

@@ -548,7 +548,11 @@
                 var searchOpts = '<option value="off"' + (agentSearchVal === 'off' ? ' selected' : '') + '>🔍 Off</option>'
                     + '<option value="duckduckgo"' + (agentSearchVal === 'duckduckgo' ? ' selected' : '') + '>🦆 DuckDuckGo</option>'
                     + '<option value="brave"' + (agentSearchVal === 'brave' ? ' selected' : '') + '>🦁 Brave</option>'
-                    + '<option value="serper"' + (agentSearchVal === 'serper' ? ' selected' : '') + '>🔎 Serper</option>';
+                    + '<option value="serper"' + (agentSearchVal === 'serper' ? ' selected' : '') + '>🔎 Serper</option>'
+                    + '<option value="tavily"' + (agentSearchVal === 'tavily' ? ' selected' : '') + '>🤖 Tavily</option>'
+                    + '<option value="google_cse"' + (agentSearchVal === 'google_cse' ? ' selected' : '') + '>🔍 Google CSE</option>'
+                    + '<option value="wikipedia"' + (agentSearchVal === 'wikipedia' ? ' selected' : '') + '>📖 Wikipedia</option>'
+                    + '<option value="wikidata"' + (agentSearchVal === 'wikidata' ? ' selected' : '') + '>📊 Wikidata</option>';
 
                 // Build upload thumbnail strip for Agent card
                 var agentUploadThumbs = '';
@@ -799,7 +803,11 @@
                 var aiSearchOpts = '<option value="off"' + (cardSearchVal === 'off' ? ' selected' : '') + '>🔍 Off</option>'
                     + '<option value="duckduckgo"' + (cardSearchVal === 'duckduckgo' ? ' selected' : '') + '>🦆 DuckDuckGo</option>'
                     + '<option value="brave"' + (cardSearchVal === 'brave' ? ' selected' : '') + '>🦁 Brave</option>'
-                    + '<option value="serper"' + (cardSearchVal === 'serper' ? ' selected' : '') + '>🔎 Serper</option>';
+                    + '<option value="serper"' + (cardSearchVal === 'serper' ? ' selected' : '') + '>🔎 Serper</option>'
+                    + '<option value="tavily"' + (cardSearchVal === 'tavily' ? ' selected' : '') + '>🤖 Tavily</option>'
+                    + '<option value="google_cse"' + (cardSearchVal === 'google_cse' ? ' selected' : '') + '>🔍 Google CSE</option>'
+                    + '<option value="wikipedia"' + (cardSearchVal === 'wikipedia' ? ' selected' : '') + '>📖 Wikipedia</option>'
+                    + '<option value="wikidata"' + (cardSearchVal === 'wikidata' ? ' selected' : '') + '>📊 Wikidata</option>';
 
                 // Build upload thumbnail strip if images are already attached
                 var uploadThumbs = '';
@@ -1815,7 +1823,7 @@
         container.querySelectorAll('.ai-agent-search-select').forEach(function (sel) {
             sel.addEventListener('change', function () {
                 var providerId = this.value;
-                if (!M.webSearch || providerId === 'off' || providerId === 'duckduckgo') return;
+                if (!M.webSearch || providerId === 'off' || providerId === 'duckduckgo' || providerId === 'wikipedia' || providerId === 'wikidata') return;
 
                 var p = M.webSearch.PROVIDERS[providerId];
                 if (!p || !p.requiresKey) return;