- 基于 API 的抓取器
使用我们的界面构建您的 API 请求 - 规模化自动化
构建自己的调度器以控制抓取频率 - 数据交付
将数据传送到您偏好的存储,或直接下载
- 通过 API 或无代码爬虫按需抓取
- 仅为成功交付的结果付费
- 批量请求处理,最多 5,000 个 URL
- 以多种格式获取结果
全球 超20000 位客户信赖
完全托管选项
通过我们的托管服务享受无忧数据体验
可用的新闻爬取工具
无需开发和维护基础设施。只需提取大规模网页数据,并通过网页爬取 API 或无代码爬取工具确保可扩展性和可靠性。
Google News
Yahoo Finance business information
Yahoo Finance business information - Discover records by keyword
BBC news
BBC news - Discover BBC articles by keyword
CNN news
CNN news - Discover CNN articles by search URL
CNN news - Discovery article by the publishing date and time
只想要数据?无需抓取。
直接购买新闻数据集
代码示例
轻松抓取新闻数据,无需担心被屏蔽。
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.bbc.com/news/articles/c0vveg0x594o","keyword":"Biden "},{"url":"https://www.bbc.com/sport/football/articles/cxx2n1y3xzro","keyword":""},{"url":"https://www.bbc.com/news/articles/c7274g1dzxeo","keyword":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_ly5lkfzd1h8c85feyh&format=json&uncompressed_webhook=true"
[
{
"db_source": "1763286584734",
"timestamp": "2025-11-16",
"id": "c4gw5n1n8e1o",
"url": "https:\/\/www.bbc.com\/sport\/rugby-union\/articles\/c4gw5n1n8e1o",
"author": "******",
"headline": "Ireland 46-19 Australia: Mack Hansen shines brightest as Irish heed Andy Farrell\u0027s call",
"topics": [
"Irish Rugby",
"Northern Ireland Sport",
"Rugby Union",
"Ireland Rugby Union"
],
"publication_date": "2025-11-16T00:25:38.830Z"
},
{
"db_source": "1763286584734",
"timestamp": "2025-11-16",
"id": "cx24zvwqdpgo",
"url": "https:\/\/www.bbc.com\/sport\/articles\/cx24zvwqdpgo",
"author": "******",
"headline": "Greece v Scotland: What Steve Clarke said",
"topics": [
"Scotland Men\u0027s Football Team"
],
"publication_date": "2025-11-15T22:18:43.288Z"
},
{
"db_source": "1763286584734",
"timestamp": "2025-11-16",
"id": "cn8xedgv61no",
"url": "https:\/\/www.bbc.com\/sport\/rugby-union\/articles\/cn8xedgv61no",
"author": "******",
"headline": "Wales 24-23 Japan: Jarrod Evans kicks late winning penalty against Eddie Jones\u0027 sidee",
"topics": [
"Welsh Rugby",
"Wales Rugby Union",
"Rugby Union"
],
"publication_date": "2025-11-15T19:48:50.074Z"
},
{
"db_source": "1763286584734",
"timestamp": "2025-11-16",
"id": "p0mgzxgp",
"url": "https:\/\/www.bbc.com\/sounds\/play\/p0mgzxgp",
"author": "******",
"headline": null,
"topics": [],
"publication_date": null
},
{
"db_source": "1763286584734",
"timestamp": "2025-11-16",
"id": "clyzeydppzdo",
"url": "https:\/\/www.bbc.com\/sport\/football\/articles\/clyzeydppzdo",
"author": "******",
"headline": "World Cup 2026: Italy fighting to avoid another \u0027apocalyptic\u0027 qualification failure",
"topics": [
"Italy",
"European Football",
"Football"
],
"publication_date": "2025-11-16T09:02:29.540Z"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://news.google.com/","keyword":"Joe Biden","country":"US","language":""},{"url":"https://news.google.com/","keyword":"Politics news","country":"FR","language":""},{"url":"https://news.google.com/","keyword":"Premier league","country":"GB","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lnsxoxzi1omrwnka5r&format=json&uncompressed_webhook=true"
[
{
"db_source": "1763255139203",
"timestamp": "2025-11-15",
"url": "https:\/\/www.msn.com\/fr-xl\/afrique-centre-et-est\/madagascar-actualite\/transformation-agricole-la-concertation-nationale-r...",
"title": "TRANSFORMATION AGRICOLE - La concertation nationale ratisse large",
"publisher": "MSN",
"date": "2025-11-15T09:45:43.000Z",
"category": null,
"keyword": "Politique agricole when:1d"
},
{
"db_source": "1763255139203",
"timestamp": "2025-11-15",
"url": "https:\/\/www.cnews.fr\/france\/2025-11-15\/une-economie-de-56-millions-de-dollars-limage-des-etats-unis-faut-il-supprimer-en",
"title": "«Une économie de 56 millions de dollars» : à l\u0027image des États-Unis, faut-il supprimer en France les pièces de 1 et 2 ce...",
"publisher": "CNews",
"date": "2025-11-15T10:08:12.000Z",
"category": null,
"keyword": "Banque France when:1d"
},
{
"db_source": "1763255139203",
"timestamp": "2025-11-15",
"url": "https:\/\/fr.businessam.be\/les-investisseurs-belges-tablent-sur-un-rendement-annuel-du-marche-boursier-de-6-pour-cent-au-c...",
"title": "Les investisseurs belges tablent sur un rendement annuel du marché boursier de 6 pour cent au cours de la prochaine déce...",
"publisher": "Business AM",
"date": "2025-11-15T12:30:00.000Z",
"category": null,
"keyword": "Marchés Boursiers when:1d"
},
{
"db_source": "1763255139203",
"timestamp": "2025-11-15",
"url": "https:\/\/www.237online.com\/des-aeroports-franco-italiens-veulent-construire-des-vertiports\/",
"title": "Des aéroports franco-italiens veulent construire des vertiports",
"publisher": "237online.com",
"date": "2021-10-26T07:00:00.000Z",
"category": null,
"keyword": "Infrastructures électriques Italie \u0026 France when:1d"
},
{
"db_source": "1763255139203",
"timestamp": "2025-11-15",
"url": "https:\/\/www.folhamax.com\/politica\/abilio-aconselha-mauro-recuar-de-briga-com-eduardo-discussao-boba\/522203?__cf_chl_rt_t...",
"title": "Abilio aconselha Mauro recuar de briga com Eduardo: \u0022discussão boba\u0022",
"publisher": "FOLHAMAX",
"date": "2025-11-11T21:03:00.000Z",
"category": null,
"keyword": "Mauro Mendes"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://edition.cnn.com/2024/07/08/politics/biden-fate-political-career/index.html"},{"url":"https://edition.cnn.com/2024/03/18/politics/video/biden-fundraising-campaign-thomas-gift-intv-031803aseg1-cnni-politics-fast"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lycz8783197ch4wvwg&format=json&uncompressed_webhook=true"
[
{
"db_source": "1763327604551",
"timestamp": "2025-11-16",
"id": "https:\/\/www.cnn.com\/2025\/11\/16\/politics\/epstein-files-petition-growing-gop-support",
"url": "https:\/\/www.cnn.com\/2025\/11\/16\/politics\/epstein-files-petition-growing-gop-support",
"author": "Pip***Hud***thB*********Ail************",
"headline": "Co-sponsors of petition to release Epstein files foresee growing GOP support for upcoming vote",
"topics": [
"politics"
],
"publication_date": "2025-11-16T19:07:27.593Z"
},
{
"db_source": "1763331205276",
"timestamp": "2025-11-16",
"id": "https:\/\/www.cnn.com\/cnn-underscored\/reviews\/babbel",
"url": "https:\/\/www.cnn.com\/cnn-underscored\/reviews\/babbel",
"author": "Ell***McA***ne",
"headline": "Babbel is down to $179 for the next week",
"topics": [
"cnn-underscored",
"reviews"
],
"publication_date": "2020-11-18T12:59:12.000Z"
},
{
"db_source": "1763331205276",
"timestamp": "2025-11-16",
"id": "https:\/\/www.cnn.com\/2025\/11\/16\/world\/iran-drought-cloud-seeding-dry-fall-climate-latam-intl",
"url": "https:\/\/www.cnn.com\/2025\/11\/16\/world\/iran-drought-cloud-seeding-dry-fall-climate-latam-intl",
"author": "Moh***ed ***fee***",
"headline": "Iran turns to cloud-seeding as historic drought causes driest fall in 50 years",
"topics": [
"world"
],
"publication_date": "2025-11-16T21:07:22.576Z"
},
{
"db_source": "1763331205276",
"timestamp": "2025-11-16",
"id": "https:\/\/www.cnn.com\/cnn-underscored\/instagram-tiktok-bfcm-2025",
"url": "https:\/\/www.cnn.com\/cnn-underscored\/instagram-tiktok-bfcm-2025",
"author": null,
"headline": "2025 Black Friday and Cyber Monday Deals List",
"topics": [
"cnn-underscored"
],
"publication_date": "2025-11-13T21:04:06.978Z"
},
{
"db_source": "1763331205276",
"timestamp": "2025-11-16",
"id": "https:\/\/www.cnn.com\/2025\/11\/16\/world\/democratic-republic-of-congo-bridge-mine-collapse-intl-latam",
"url": "https:\/\/www.cnn.com\/2025\/11\/16\/world\/democratic-republic-of-congo-bridge-mine-collapse-intl-latam",
"author": null,
"headline": "At least 32 killed in southeastern DRC after bridge at mine collapsed, authorities say",
"topics": [
"world"
],
"publication_date": "2025-11-16T21:20:55.124Z"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.reuters.com/sports/soccer/reaction-spains-victory-over-england-euro-2024-final-2024-07-14/"},{"url":"https://www.reuters.com/sports/soccer/england-miss-out-silverware-yet-again-earn-respect-2024-07-14/"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lyptx9h74wtlvpnfu&format=json&uncompressed_webhook=true"
[
{
"db_source": "j_mblsggbe1g45oxjleb",
"timestamp": "2025-06-07",
"id": "37B3ARYOKNPKRN6K3WPH7LEVOA",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/mohammad-sinwar-hamas-chief-gaza-declared-eliminated-by-israel-2025-05-28\/",
"author": "Nid***Al-***hra***",
"headline": "Who is Mohammad Sinwar, the Hamas chief in Gaza declared eliminated by Israel?",
"topics": [
"Reuters logo",
"DeathInjrConft",
"hlth",
"pol",
"DeathInjrConft",
"DeathInjrConft",
"DeathInjrConft"
],
"publication_date": "2025-05-28T16:00:49.000Z"
},
{
"db_source": "j_mblsggbe1g45oxjleb",
"timestamp": "2025-06-07",
"id": "F4CF3QFHHJP2FE2PRDGV6VHM3E",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/netanyahu-says-hamas-gaza-chief-mohammed-sinwar-has-been-eliminated-2025-05-28...",
"author": "Reu***s",
"headline": "Netanyahu says Hamas Gaza chief Mohammad Sinwar has been killed",
"topics": [
"A screengrab shows according to the Israeli Army, Hamas Gaza chief Mohammed Sinwar, taken from a handout video",
"DeathInjrConft",
"pol",
"DeathInjrConft"
],
"publication_date": "2025-05-28T15:08:09.000Z"
},
{
"db_source": "j_mblsggbe1g45oxjleb",
"timestamp": "2025-06-07",
"id": "A6SJAKPK2JPW3C43AYMNUJLPBE",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/netanyahu-says-israel-probably-killed-hamas-leader-mohammed-sinwar-2025-05-21\/",
"author": "Reu***s",
"headline": "Netanyahu says Israel probably killed Hamas leader Mohammed Sinwar",
"topics": [
"Israeli Prime Minister Netanyahu attends a press conference, in Jerusalem",
"DeathInjrConft",
"legal",
"pol",
"DeathInjrConft",
"DeathInjrConft",
"DeathInjrConft"
],
"publication_date": "2025-05-21T17:43:25.000Z"
},
{
"db_source": "j_mblsggbe1g45oxjleb",
"timestamp": "2025-06-07",
"id": "N2GK3PVSA5MYRFIKO5MEYIPYVA",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/israel-airstrike-kills-least-24-gaza-mediators-host-ceasefire-talks-2025-05-17...",
"author": "Nid***Al-***hra*********n L******",
"headline": "Israel says it will let food into Gaza after announcing new ground assault",
"topics": [
"Aftermath of an Israeli strike on a tent camp sheltering displaced people, in Khan Younis, southern Gaza Strip",
"DeathInjrConft",
"hlth",
"hlthcr",
"pol",
"DeathInjrConft",
"DeathInjrConft"
],
"publication_date": "2025-05-18T23:33:14.000Z"
},
{
"db_source": "j_mblsggbe1g45oxjleb",
"timestamp": "2025-06-07",
"id": "EWXBJRRKCBIHTH43VI3J6YS2II",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/israel-attacks-yemeni-ports-houth-run-television-says-2025-05-16\/",
"author": "Reu***s",
"headline": "Israel attacks Yemeni ports, warns that Houthi leader could be target",
"topics": [
"Reuters logo",
"aero",
"aero",
"DeathInjrConft",
"media",
"pol",
"trans",
"DeathInjrConft"
],
"publication_date": "2025-05-16T18:35:18.000Z"
}
]
一次API调用,大量数据。
数据发现
检测数据结构和模式,以确保高效、针对性的数据提取。
批量请求处理
降低服务器负载,并为大规模抓取任务优化数据采集。
数据解析
高效地将原始 HTML 转换为结构化数据,简化数据集成与分析。
数据验证
确保数据可靠性,节省人工检查与预处理时间。
再也不用担心代理和验证码了
- 自动IP轮换
- 验证码解决方案
- 用户代理轮换
- 自定义请求头
- JavaScript 渲染
- 住宅代理
定价
易于开始,更易扩展。
无与伦比的稳定性
依靠全球领先的代理基础设施,确保一致的性能并将故障降至最低。
简化的网页抓取
使用可投入生产的API将您的抓取任务自动化,节省资源并减少维护。
无限扩展性
轻松扩展您的抓取项目以满足数据需求,同时保持最佳性能。
用于无缝新闻数据访问的API
全面、可扩展且合规的新闻数据提取
量身定制您的工作流程
通过Webhook或API交付,以JSON、NDJSON或CSV文件获取结构化的LinkedIn数据。
内置基础设施和解封功能
无需维护代理和解封基础设施,即可获得最完全的控制和灵活性。轻松从任何地理位置抓取数据,同时避免验证码和封锁。
经过实战验证的基础设施
Bright Data平台为全球超过超20000家公司提供支持,确保99.99%的正常运行时间,并提供覆盖195个国家的超15000万个真实用户IP。
行业领先的合规性
我们的隐私实践符合数据保护法律,包括欧盟数据保护法规框架、GDPR和CCPA,尊重行使隐私权的请求等。
热门新闻抓取 API
CNN 抓取工具 API
抓取 CNN 以收集数据,如标题、作者、主题、发布日期、内容、图片、相关文章等。
Google News 抓取工具 API
抓取 Google News 以收集数据,如标题、主题、类别、作者、日期、来源等。
路透社抓取工具 API
抓取路透社以收集数据,如ID、URL、作者、标题、话题、发布日期、主题等。
BBC 抓取工具 API
抓取 BBC 以收集数据,如标题、作者、主题、发布日期、内容、图片、相关文章等。
还有更多......
新闻抓取工具 - 新闻爬虫工具 API 的用例
为您的研究抓取新闻
收集有关网站新闻发布量的数据
确定热门主题
根据竞争对手的数据优化自身新闻网站的写作
为什么 超20000 位客户选择Bright Data
100%合规
全球 24/7 支持
全面的数据覆盖
无与伦比的数据质量
强大的基础设施
定制化解决方案
新闻抓取工具 - 新闻爬虫工具 API 常见问题
什么是新闻抓取 API?
新闻抓取 API 是一款强大的工具,旨在自动从新闻网站提取数据,使用户能够高效地收集和处理大量数据,以满足各种使用需求。
新闻爬虫 API 是如何工作的?
新闻爬虫 API 通过向新闻网站发送自动请求,提取所需的数据点,并以结构化格式提供。这一过程确保了数据收集的准确性和快速性。
新闻抓取 API 是否符合数据保护法规?
是的,新闻抓取 API 设计符合数据保护法规,包括 GDPR 和 CCPA。它确保所有数据收集活动均以合乎道德和法律的方式进行。
我可以使用新闻抓取 API 进行竞争分析吗?
绝对可以!新闻抓取 API 非常适合用于竞争分析,帮助您收集有关竞争对手在新闻网站上的活动、趋势和策略的洞察。
如何将新闻爬虫 API 集成到我现有的系统中?
新闻爬虫 API 可以无缝集成到各种平台和工具中。您可以将其与现有的数据管道、CRM 系统或分析工具结合使用,以提高数据处理能力。
新闻抓取 API 的使用限制是什么?
新闻抓取 API 没有特定的使用限制,为您提供了按需扩展的灵活性。价格从每条记录 $0.001 起,确保您的网页抓取项目具有成本效益的可扩展性。
您提供新闻抓取 API 的支持吗?
是的,我们为新闻抓取 API 提供专门的支持。我们的支持团队全天候 24/7 可随时为您解答在使用 API 过程中遇到的任何问题。
有哪些交付方式可用?
Amazon S3、Google Cloud Storage、Google PubSub、Microsoft Azure Storage、Snowflake 和 SFTP。
有哪些文件格式可用?
JSON、NDJSON、JSON lines、CSV 和 .gz 文件(压缩)。