jbell730/anya - anya

16 Commits

1 Branch

1.9 MiB

Commit Graph

Author	SHA1	Message	Date
Jared Bell	ad03cd96ce	Add SSR/embedded-JSON extraction and restore Forbes services/ssr.py walks JSON-LD and Next.js __NEXT_DATA__ for article-like objects (headline, or title+url, or name with article signals), recovering JS-rendered sites without a browser. prepare_headlines favors embedded JSON over regex link scraping. Forbes is re-added as a live proof.	4 days ago

Author

SHA1

Message

Date

Jared Bell

ad03cd96ce

Add SSR/embedded-JSON extraction and restore Forbes

services/ssr.py walks JSON-LD and Next.js __NEXT_DATA__ for article-like
objects (headline, or title+url, or name with article signals), recovering
JS-rendered sites without a browser. prepare_headlines favors embedded JSON
over regex link scraping. Forbes is re-added as a live proof.

4 days ago

1 Commits (1f61810979063239470aaade0da1c143aa677a0b)