Review: Upgrade Nemo model from Sonnet 4 to Sonnet 4.6 (re-review)

review-730-2026-03-30-r2 Doc

review ready

Verdict: APPROVED

Re-review of board item #730 after refinement. Previous review: review-730-2026-03-30 (NEEDS_REFINEMENT). All blocking issues from the first review have been addressed.

Template Completeness

  • [x] Type -- Feature
  • [x] Lineage -- Standalone, references #27 (db_query tool)
  • [x] Repo -- forgejo_admin/pal-e-deployments (corrected from westside-ai-assistant)
  • [x] User Story -- "As Marcus (admin), I want Nemo to understand complex questions and generate accurate SQL"
  • [x] Context -- correctly describes Sonnet 4 to Sonnet 4.6 upgrade (Haiku reference removed)
  • [x] File Targets -- explicit path with line number
  • [x] Acceptance Criteria -- 3 criteria
  • [x] Test Expectations -- manual testing described
  • [x] Constraints -- kustomize persistence + cost monitoring
  • [x] Checklist -- standard PR checklist
  • [x] Related -- project-westside-basketball + sibling #27

Traceability

  • [x] story:WS-S5 label -- present. WS-S5 (Admin) = "view registration stats on dashboard." The AI model upgrade directly serves Marcus's ability to query program data via Nemo. Stretch but justified per refinement rationale: better model = better SQL generation = better data access for admin. Accepted.
  • [x] story note verified -- WS-S5 exists in project-westside-basketball user-stories section under both Superadmin and Admin roles.
  • [x] arch:westside-ai-assistant label -- present on board item
  • [ ] arch note MISSING -- arch-westside-ai-assistant does not exist in pal-e-docs. [SCOPE] Create architecture note arch-westside-ai-assistant. (Deferred as discovered scope per refinement -- not a blocker for this ticket.)
  • [x] Forgejo issue -- forgejo_admin/westside-ai-assistant#28, open

File Targets

  • [x] overlays/westside-ai-assistant/prod/deployment-patch.yaml line 16 -- verified. Current value is claude-sonnet-4-20250514. Target value claude-sonnet-4-6-20250514 follows the same Anthropic model ID format (claude-{family}-{date}).
  • [x] "Files NOT to touch" section correctly excludes application code and base deployment.

Repo Placement

Forgejo issue is filed on forgejo_admin/westside-ai-assistant but the Repo section correctly states forgejo_admin/pal-e-deployments and the file path explicitly references the cross-repo target. For a single-file config change, filing on the logical component repo with an explicit cross-repo note is acceptable. No re-filing needed.

Dependencies

  • [x] Board item #729 (Add read-only SQL tool, issue #27) -- in backlog, same arch label. Complementary but independent. The model upgrade benefits SQL generation but does not depend on #729 shipping first. No blocker.
  • [x] No items in in_progress block this work.

Acceptance Criteria

  • [x] "ANTHROPIC_MODEL env var set to claude-sonnet-4-6-20250514 in kustomize overlay" -- verifiable via kubectl or file diff. Testable.
  • [x] "Nemo responds correctly after ArgoCD sync" -- verifiable manually. Acceptable for a GroupMe bot.
  • [x] "Latency acceptable (under 5s for typical questions)" -- measurable manually. Acceptable.
3 AC, all verifiable. No subjective "higher quality" criterion -- this was improved from the first review.

Blast Radius

Low. ANTHROPIC_MODEL is only referenced in pal-e-deployments/overlays/westside-ai-assistant/prod/deployment-patch.yaml. Not used in pal-e-services or any other overlay. No downstream consumers. Cost impact (Sonnet 4 vs 4.6 pricing) is the main concern, already noted in Constraints. Rollback is trivial -- revert one env var value.

Decomposition Assessment

No decomposition needed. 1 file target, 1 line change, 3 acceptance criteria, 0 code changes. Well under the five-minute rule.

Recommendation

  • [LABEL] Update board item #730 title to match Forgejo issue: "Upgrade Nemo model from Sonnet 4 to Sonnet 4.6" (currently says "from Haiku 4.5").
  • [SCOPE] Create architecture note arch-westside-ai-assistant for the AI assistant component. (Discovered scope -- track as separate board item.)
No blocking issues remain. Ticket is ready for dispatch.