Arc 03 · Sensing what the locked-down web won't give you.
- What it is
- Three public-source scanners — trend-radar (trends → content topics), voice-radar (voices → outreach), role-radar (roles → job hunt) — that sense AI/tech momentum from HackerNews, HuggingFace, and curated newsletters, normalize it into a shared taxonomy, score it, and feed the graph.
- Why it exists
- LinkedIn, where the audience is, has no legitimate trend API and scraping is ruled out. But the same trends surface first on HN / HuggingFace / newsletters anyway. The scanners sense from legitimate public sources instead of fighting a locked-down platform — an honest proxy, not a workaround for parity.
- The value
- Momentum Alex can't otherwise get, ethically sourced, normalized so “AI agents” and “agentic systems” count as one topic, and decayed so last month's hype doesn't outrank this week's signal. Cross-source corroboration — a topic featured across HN + HF + newsletters — is the trust signal.
- Best practices it draws on
- The whole game is taxonomy (normalization so corroboration is countable) and decay (recency half-life), both borrowed from dedicated skills rather than reinvented per scanner. Source-weighting (papers for substance, newsletters for editorial vote, HN for velocity). Public APIs / RSS / official endpoints only — a hard ethical line, and no fabricated numbers ever.
- What V1 doesn't do yet
- Three sources, manual trigger; the LinkedIn-native gap is real and unclosable — stated honestly, not papered over; topic over/under-merging still needs a human eye.
- Where it goes
- Next: YED-149 roles → spine · YED-145 mentions feed (parked) · more sources when a scan misses something real.
- Enterprise tie-in
- “Social listening” tools are mechanically simple — poll, normalize, score, rank — and the hard part is always normalization + decay, not the fetch. Building the honest version (legitimate sources, stated gaps, measured-not-invented numbers) is exactly the discipline that separates a trustworthy market-intel product from a scraper that lies.