jbell730
/
anya
1
0
Форк 0
Код Проблеми 0 Запити на злиття 0 Релізи 0 Вікі Активність
Ви не можете вибрати більше 25 тем Теми мають розпочинатися з літери або цифри, можуть містити дефіси (-) і не повинні перевищувати 35 символів.
16 Коміти
1 Гілка
1.4 MiB
Гілка: master
Гілки Теги
${ item.name }
Створити гілку ${ searchTerm }
з 'master'
${ noResults }
anya/resources/sources.txt

sources.txt 1.9 KiB
Неформатований Постійне посилання Звичайний вигляд Історія

Swap HTML sources for RSS feeds; drop outlets without RSS Replace JS-heavy/paywalled HTML sources with verified RSS feeds (CNN, Fox, NBC, NPR, CBS, NYT, Time, Axios). Drop Reuters, AP, Forbes, MSN and US News, which offer no public/working RSS and are not reliably scrapable.
3 дні тому
Add international and regional RSS sources Add English-language international feeds: DW, Le Monde (English ed.), France24, Euronews, Der Spiegel, El Pais (EN), The Japan Times, SCMP, ABC News Australia, and CBC. Nikkei offers no clean public RSS, so Japan Times + SCMP cover Japan/Asia instead.
3 дні тому
​
Swap HTML sources for RSS feeds; drop outlets without RSS Replace JS-heavy/paywalled HTML sources with verified RSS feeds (CNN, Fox, NBC, NPR, CBS, NYT, Time, Axios). Drop Reuters, AP, Forbes, MSN and US News, which offer no public/working RSS and are not reliably scrapable.
3 дні тому
​
​
​
​
​
​
​
​
​
​
Add international and regional RSS sources Add English-language international feeds: DW, Le Monde (English ed.), France24, Euronews, Der Spiegel, El Pais (EN), The Japan Times, SCMP, ABC News Australia, and CBC. Nikkei offers no clean public RSS, so Japan Times + SCMP cover Japan/Asia instead.
3 дні тому
​
​
​
​
Add RSS/Atom support, expand sources and excluded phrases - services/feeds.py parses RSS 2.0/1.0 and Atom into (title, date) entries - prepare_headlines auto-detects feeds by content and parses them directly - strip feeds./rss./moxie. subdomains so feeds collapse to the outlet domain - add 7 verified RSS feeds (BBC, Guardian, Al Jazeera, WaPo, The Hill, Vox, CNBC) - get_sources skips blank lines and # comments - broaden excluded-phrase list (skip links, share/follow, newsletter, utility)
3 дні тому
​
Add international and regional RSS sources Add English-language international feeds: DW, Le Monde (English ed.), France24, Euronews, Der Spiegel, El Pais (EN), The Japan Times, SCMP, ABC News Australia, and CBC. Nikkei offers no clean public RSS, so Japan Times + SCMP cover Japan/Asia instead.
3 дні тому
​
​
​
​
​
Adjust similarity threshold and minimum source count, add additional RSS feeds - Lower `SIMILARITY_THRESHOLD` to 0.68 and raise `MIN_SOURCES` to 3 for stricter story clustering. - Expand `sources.txt` with new international and regional RSS feeds, including RT, The Jakarta Post, Philstar, and others. - Add a new "Miscellaneous" section for diverse investigatory sources like The Intercept, OCCRP, and Bellingcat.
2 дні тому
​
Add international and regional RSS sources Add English-language international feeds: DW, Le Monde (English ed.), France24, Euronews, Der Spiegel, El Pais (EN), The Japan Times, SCMP, ABC News Australia, and CBC. Nikkei offers no clean public RSS, so Japan Times + SCMP cover Japan/Asia instead.
3 дні тому
​
Add RSS/Atom support, expand sources and excluded phrases - services/feeds.py parses RSS 2.0/1.0 and Atom into (title, date) entries - prepare_headlines auto-detects feeds by content and parses them directly - strip feeds./rss./moxie. subdomains so feeds collapse to the outlet domain - add 7 verified RSS feeds (BBC, Guardian, Al Jazeera, WaPo, The Hill, Vox, CNBC) - get_sources skips blank lines and # comments - broaden excluded-phrase list (skip links, share/follow, newsletter, utility)
3 дні тому
Add international and regional RSS sources Add English-language international feeds: DW, Le Monde (English ed.), France24, Euronews, Der Spiegel, El Pais (EN), The Japan Times, SCMP, ABC News Australia, and CBC. Nikkei offers no clean public RSS, so Japan Times + SCMP cover Japan/Asia instead.
3 дні тому
Adjust similarity threshold and minimum source count, add additional RSS feeds - Lower `SIMILARITY_THRESHOLD` to 0.68 and raise `MIN_SOURCES` to 3 for stricter story clustering. - Expand `sources.txt` with new international and regional RSS feeds, including RT, The Jakarta Post, Philstar, and others. - Add a new "Miscellaneous" section for diverse investigatory sources like The Intercept, OCCRP, and Bellingcat.
2 дні тому
​
​
Swap HTML sources for RSS feeds; drop outlets without RSS Replace JS-heavy/paywalled HTML sources with verified RSS feeds (CNN, Fox, NBC, NPR, CBS, NYT, Time, Axios). Drop Reuters, AP, Forbes, MSN and US News, which offer no public/working RSS and are not reliably scrapable.
3 дні тому
​
Normalize headlines with common aliases, adjust threshold to 0.64, and expand RSS sources list.
1 день тому
Add RSS/Atom support, expand sources and excluded phrases - services/feeds.py parses RSS 2.0/1.0 and Atom into (title, date) entries - prepare_headlines auto-detects feeds by content and parses them directly - strip feeds./rss./moxie. subdomains so feeds collapse to the outlet domain - add 7 verified RSS feeds (BBC, Guardian, Al Jazeera, WaPo, The Hill, Vox, CNBC) - get_sources skips blank lines and # comments - broaden excluded-phrase list (skip links, share/follow, newsletter, utility)
3 дні тому
​
Normalize headlines with common aliases, adjust threshold to 0.64, and expand RSS sources list.
1 день тому
​
​
​
Swap HTML sources for RSS feeds; drop outlets without RSS Replace JS-heavy/paywalled HTML sources with verified RSS feeds (CNN, Fox, NBC, NPR, CBS, NYT, Time, Axios). Drop Reuters, AP, Forbes, MSN and US News, which offer no public/working RSS and are not reliably scrapable.
3 дні тому
​
Add SSR/embedded-JSON extraction and restore Forbes services/ssr.py walks JSON-LD and Next.js __NEXT_DATA__ for article-like objects (headline, or title+url, or name with article signals), recovering JS-rendered sites without a browser. prepare_headlines favors embedded JSON over regex link scraping. Forbes is re-added as a live proof.
2 дні тому
Merge remote changes (thresholds, extra feeds) with SSR extractor
2 дні тому
Adjust similarity threshold and minimum source count, add additional RSS feeds - Lower `SIMILARITY_THRESHOLD` to 0.68 and raise `MIN_SOURCES` to 3 for stricter story clustering. - Expand `sources.txt` with new international and regional RSS feeds, including RT, The Jakarta Post, Philstar, and others. - Add a new "Miscellaneous" section for diverse investigatory sources like The Intercept, OCCRP, and Bellingcat.
2 дні тому
​
​
​
Merge remote changes (thresholds, extra feeds) with SSR extractor
2 дні тому
Normalize headlines with common aliases, adjust threshold to 0.64, and expand RSS sources list.
1 день тому
​
​
​
​
 1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859 
  1. # Anya news sources — one URL per line, RSS/Atom feeds preferred.

  2. # Feed type is auto-detected by content. '#' comments and blank lines are ignored.

  3. # English-language feeds are preferred so cross-outlet clustering works.

  4. 

  5. # US wires & majors

  6. http://rss.cnn.com/rss/cnn_topstories.rss

  7. https://moxie.foxnews.com/google-publisher/latest.xml

  8. https://feeds.nbcnews.com/nbcnews/public/news

  9. https://feeds.npr.org/1001/rss.xml

  10. https://www.cbsnews.com/latest/rss/main

  11. https://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml

  12. https://time.com/feed/

  13. https://api.axios.com/feed/

  14. 

  15. # Canada & Oceania

  16. https://www.cbc.ca/cmlink/rss-topstories

  17. https://www.abc.net.au/news/feed/2942460/rss.xml

  18. 

  19. # UK & Europe

  20. https://feeds.bbci.co.uk/news/world/rss.xml

  21. https://www.theguardian.com/us-news/rss

  22. https://rss.dw.com/rdf/rss-en-all

  23. https://www.lemonde.fr/en/rss/une.xml

  24. https://www.france24.com/en/rss

  25. https://www.euronews.com/rss?format=mrss&level=theme&name=news

  26. https://www.spiegel.de/international/index.rss

  27. https://feeds.elpais.com/mrss-s/pages/ep/site/english.elpais.com/portada

  28. https://www.rt.com/rss/news/

  29. https://tvpworld.com/69471092/news

  30. 

  31. # Middle East & Asia

  32. https://www.aljazeera.com/xml/rss/all.xml

  33. https://www.japantimes.co.jp/feed/

  34. https://www.scmp.com/rss/322262/feed/

  35. https://www.philstar.com/rss/world

  36. https://www.thejakartapost.com/

  37. 

  38. # Policy & national

  39. # https://feeds.washingtonpost.com/rss/world

  40. https://thehill.com/feed/

  41. https://www.vox.com/rss/index.xml

  42. https://feeds.feedburner.com/breitbart

  43. https://justthenews.com/rss.xml

  44. https://www.usatoday.com/

  45. https://feeds.skynews.com/feeds/rss/us.xml

  46. 

  47. # Business

  48. https://www.cnbc.com/id/100003114/device/rss/rss.html

  49. https://www.forbes.com/business/

  50. 

  51. # Miscellaneous

  52. https://theintercept.com/feed/

  53. https://www.occrp.org/en

  54. https://www.bellingcat.com/

  55. https://www.icij.org/feed/

  56. https://www.propublica.org/feeds/propublica/main

  57. https://forbiddenstories.org/feed/

  58. https://www.themarshallproject.org/rss/recent

  59. https://www.yahoo.com/news/