Add RSS/Atom support, expand sources and excluded phrases
- services/feeds.py parses RSS 2.0/1.0 and Atom into (title, date) entries
- prepare_headlines auto-detects feeds by content and parses them directly
- strip feeds./rss./moxie. subdomains so feeds collapse to the outlet domain
- add 7 verified RSS feeds (BBC, Guardian, Al Jazeera, WaPo, The Hill, Vox, CNBC)
- get_sources skips blank lines and # comments
- broaden excluded-phrase list (skip links, share/follow, newsletter, utility)
3 dagen geleden |
12345678910111213141516171819202122232425262728 |
- https://www.cnn.com/us
- https://www.cnn.com/politics
- https://www.foxnews.com/us
- https://www.foxnews.com/politics
- https://www.nbcnews.com/us-news
- https://www.nbcnews.com/politics
- https://www.reuters.com/world/us/
- https://apnews.com/us-news
- https://apnews.com/politics
- https://www.npr.org/sections/national/
- https://www.npr.org/sections/politics/
- https://www.cbsnews.com/us/
- https://www.cbsnews.com/politics/
- https://www.forbes.com/business/
- https://www.ms.now/
- https://www.nytimes.com/section/us
- https://www.nytimes.com/section/politics
- https://www.usnews.com/news
- https://time.com/
- https://www.axios.com/politics-policy
- # RSS feeds (parsed as structured XML rather than scraped HTML)
- https://feeds.bbci.co.uk/news/world/rss.xml
- https://www.theguardian.com/us-news/rss
- https://www.aljazeera.com/xml/rss/all.xml
- https://feeds.washingtonpost.com/rss/world
- https://thehill.com/feed/
- https://www.vox.com/rss/index.xml
- https://www.cnbc.com/id/100003114/device/rss/rss.html
|
