tcpsyn 69b7078142 Fix research hanging: add timeouts, fix keyword extraction, cache failures ...

- Google News RSS returns 302: add follow_redirects and User-Agent header
- Cache failed headline fetches for 5min so they don't retry every call
- Add 8s timeout on background research tasks
- Fix keyword extraction: skip short texts, require 2+ proper nouns (not names),
  increase min word length to 6, add radio show filler to stop words
- Stops garbage searches like "Megan welcome" and "sounds thats youre"

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-02-06 21:25:31 -07:00

8.4 KiB

Raw Blame History

View Raw