Retire Netlify: relocate shared AutoBot modules to shared/, delete netlify/ + netlify.toml (#864) (#878)

Option B (full retirement) per owner's issue decision. netlify/functions/
was not dead code: functions/api/gemini-proxy.js (the live Cloudflare
AutoBot proxy) and the build-time index generators (scripts/build-autobot-
index.mjs, scripts/build-llms-txt.mjs) both import from it.

- Relocate the 5 live modules (autobot-core.mjs, github-context.mjs,
  docs-retrieval.mjs, docs-loader.mjs, constants.mjs) to a new top-level
  shared/ directory -- not functions/, which is a routing-sensitive path
  for this repo's Cloudflare Pages Functions convention. shared/ reflects
  that these modules serve both the worker runtime and build-time scripts,
  not just one.
- Delete the dead netlify/functions/gemini-proxy.mjs handler (superseded by
  functions/api/gemini-proxy.js; nothing imported it).
- Update every importer: functions/api/gemini-proxy.js, scripts/build-
  autobot-index.mjs, scripts/build-llms-txt.mjs, tests/docs-loader.test.js,
  tests/enhanced-instruction.test.js, demo-autobot-approach.mjs.
- Fix shared/docs-loader.mjs's currentDir-relative paths to snippets.json
  and docs/ for the new (one level shallower) location.
- Delete the now-empty netlify/ directory and netlify.toml (its redirects
  were already fully mirrored by docusaurus.config.js's
  plugin-client-redirects).
- Sync docs/maintainers/site-operations.md and README.md to drop retired
  Netlify build/hosting references; update docusaurus.config.js's redirect
  comment to stop citing netlify.toml as authoritative.

Verified: yarn build (regenerates static/autobot-index.json, 1,992,757
bytes), yarn test, yarn typecheck, yarn test:playwright (12/12), docs-
quality.test.js, and check-doc-duplicates.mjs all green.

Closes #864


Claude-Session: https://claude.ai/code/session_01V6zjrMRZpHqfeem4PkCkLn

Co-authored-by: Claude Fable 5 <noreply@anthropic.com>

Author: MohabMohie

README.md

@@ -46,4 +46,4 @@ as the engine change and link the engine pull request.
 
 GitHub Pages publishes the public guide at `https://shafthq.github.io/`.
 Cloudflare Workers hosts the AutoBot backend API and can serve the same static
-build as a mirror; Netlify can still host preview/static mirrors.
+build as a mirror.

demo-autobot-approach.mjs

@@ -7,7 +7,7 @@
  * 3. Key SHAFT topics are included in the context
  */
 
-import { loadDocumentation, getGitHubRepositoryContext } from './netlify/functions/docs-loader.mjs';
+import { loadDocumentation, getGitHubRepositoryContext } from './shared/docs-loader.mjs';
 
 console.log('===========================================');
 console.log('AutoBot Documentation-Based Approach Demo');

docs/maintainers/site-operations.md

@@ -4,7 +4,7 @@ title: Documentation site operations
 description: Develop, validate, and deploy the canonical SHAFT documentation site.
 slug: /maintainers/site-operations
 sidebar_position: 2
-tags: [maintainers, docusaurus, cloudflare-workers, github-pages, netlify]
+tags: [maintainers, docusaurus, cloudflare-workers, github-pages]
 ---
 
 # Documentation site operations
@@ -33,10 +33,6 @@ uploads `build/` through `[assets]`, and routes `/api/gemini-proxy` through
 `worker/index.js`. Set `YARN_VERSION=1.22.22` and `GEMINI_API_KEY` in
 Cloudflare environment variables; do not commit secrets.
 
-Netlify uses `yarn build`, publishes `build/`, and serves functions from
-`netlify/functions/`. `GEMINI_API_KEY` belongs in the Netlify environment; it
-must never be embedded in the browser bundle.
-
 GitHub Pages uses `.github/workflows/deploy.yml` and publishes `build/` as the
 canonical public guide at `https://shafthq.github.io/`.
 
@@ -87,8 +83,8 @@ AutoBot indexes Markdown and MDX by route and heading at startup, retrieves the
 eight best chunks for each question, and caps injected documentation context at
 80,000 characters. `yarn build` writes `static/autobot-index.json`; the
 Cloudflare function fetches that static index at runtime, so AutoBot does not
-depend on GitHub Pages server-side code or Netlify filesystem access.
-`EXCLUDED_DIRECTORIES` in `netlify/functions/docs-loader.mjs` excludes
+depend on GitHub Pages server-side code.
+`EXCLUDED_DIRECTORIES` in `shared/docs-loader.mjs` excludes
 `archive/` and `superpowers/` only -- `docs/maintainers/` is intentionally
 included per #795 ("make docs/maintainers/ fully public"), and
 `tests/docs-loader.test.js` asserts that inclusion; local search's
@@ -101,5 +97,6 @@ unchanged.
 - Reuse commands and dependency snippets from `src/components/DocSnippets`.
 - Put historical records under `docs/archive/`; archive routes are unlisted and
   emit `noindex`.
-- Add redirects in `netlify.toml` when replacing a public route.
+- Add redirects to the `plugin-client-redirects` config in
+  `docusaurus.config.js` when replacing a public route.
 - Coordinate public behavior changes with a linked SHAFT_ENGINE pull request.

docusaurus.config.js

@@ -221,11 +221,11 @@ const config = {
       require.resolve('@docusaurus/plugin-client-redirects'),
       /** @type {import('@docusaurus/plugin-client-redirects').Options} */
       ({
-        // GitHub Pages (the canonical host) can't serve netlify.toml's
-        // server-side 301s, so this plugin emits static meta-refresh pages
-        // for the same legacy URLs. Keep this list mirroring netlify.toml's
-        // `[[redirects]]` entries — netlify.toml stays authoritative for the
-        // secondary/fallback Netlify host.
+        // GitHub Pages (the canonical, and since issue #864, only host)
+        // can't serve server-side 301s, so this plugin emits static
+        // meta-refresh pages for legacy URLs instead. This list is the
+        // sole source of truth for redirects (netlify.toml, previously a
+        // secondary/fallback host's redirect config, was retired in #864).
         createRedirects(existingPath) {
           const wildcardPrefixMap = {
             '/docs/reference/actions/': '/docs/Keywords/',

functions/api/gemini-proxy.js

@@ -1,6 +1,6 @@
-import { createAutobotResponse } from '../../netlify/functions/autobot-core.mjs';
-import { getGitHubRepositoryContext } from '../../netlify/functions/github-context.mjs';
-import { loadDocumentationFromIndex } from '../../netlify/functions/docs-retrieval.mjs';
+import { createAutobotResponse } from '../../shared/autobot-core.mjs';
+import { getGitHubRepositoryContext } from '../../shared/github-context.mjs';
+import { loadDocumentationFromIndex } from '../../shared/docs-retrieval.mjs';
 
 let cachedIndex = null;
 let cachedGitHubContext = null;

netlify.toml

@@ -1,7 +1,7 @@
 import {mkdir, writeFile} from 'node:fs/promises';
 import path from 'node:path';
 import {fileURLToPath} from 'node:url';
-import {buildDocumentationIndex} from '../netlify/functions/docs-loader.mjs';
+import {buildDocumentationIndex} from '../shared/docs-loader.mjs';
 
 const root = path.resolve(path.dirname(fileURLToPath(import.meta.url)), '..');
 const outputPath = path.join(root, 'static', 'autobot-index.json');

netlify/functions/gemini-proxy.mjs

@@ -1,7 +1,7 @@
 import {mkdir, readFile, writeFile} from 'node:fs/promises';
 import path from 'node:path';
 import {fileURLToPath} from 'node:url';
-import {buildDocumentationIndex} from '../netlify/functions/docs-loader.mjs';
+import {buildDocumentationIndex} from '../shared/docs-loader.mjs';
 
 const root = path.resolve(path.dirname(fileURLToPath(import.meta.url)), '..');
 const docsRoot = path.join(root, 'docs');