125.5K+
11.6K+
- 使用任意语言构建请求
- 使用调度器和 webhook 自动化
- 支持 JSON、NDJSON 或 CSV 交付
网页爬虫工具 API 库
选择一个爬虫工具并调用。每个爬虫工具都会列出其输出字段、交付量和实时成功率。
网页爬虫工具 API 定价
仅为成功交付的内容付费。无隐藏费用，失败交付不收费。
我们接受这些支付方式:
工作原理
3 步从零开始获取数据
无需配置代理，无需管理基础设施。选择、调用并接收数据。
-
选择一个爬虫工具
从上方的 [current_scraper_name} 爬虫工具中选择，或在几分钟内用 AI 创建你自己的爬虫工具。
-
调用 API
一次 API 调用最多支持 5,000 个目标 URL。可使用 Python 和 Node.js SDK、CLI、MCP 服务器或任意 HTTP 客户端。
-
获取结构化数据
接收干净、已解析的 [current_scrper_name] 数据，格式支持 JSON、NDJSON 或 CSV。可通过 API、webhook 或云存储交付。
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","asin":"B0CRMZHDG8","origin_url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","zipcode":"94107","language":""},{"url":"https://www.amazon.com/KitchenAid-Protective-Dishwasher-Stainless-8-72-Inch/dp/B07PZF3QS3","asin":"B07PZF3QS3","zipcode":"","language":""},{"url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","asin":"","origin_url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","zipcode":"94124","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l7q7dkf244hwjntr0&format=json&uncompressed_webhook=true"
Response payload
[
{
"db_source": "1788947229099",
"timestamp": "2026-09-09",
"title": "Fingerprint Padlock, Dhiedas Pad Lock with Fingerprint Bluetooth Key Waterproof Heavy Duty Combination Lock for Outdoor ...",
"seller_name": "ZHO***HAN***RUI***",
"brand": "Dhiedas",
"description": "About this item 🔐【Fingerprint Padlock with Key backup】Adopted advanced biometric technology, fingerprint padlock quickl...",
"initial_price": 47.19,
"currency": "USD"
},
{
"db_source": "1788947229099",
"timestamp": "2026-09-09",
"title": "SANNIX 20 Pieces Cartoon Cute Gel Ink RollerBall Pens Bulk Assorted Styles Novelty Writing Pen for Kids Gift School Offi...",
"seller_name": "******",
"brand": "SANNIX",
"description": "About this item What Will You Receive: You will receive 20 cute cartoon gel pens in different styles, with animal shapes...",
"initial_price": 7.99,
"currency": "USD"
},
{
"db_source": "1788947229099",
"timestamp": "2026-09-09",
"title": "Biomar Labs Front Hood Trunk Tuning Badge 82mm Compatible with BMW Emblem 51148132375 Eyes EO 8",
"seller_name": "Biomar L**s",
"brand": "Biomar Labs",
"description": "Compatible with BMW emblem with part number 51148132375. Compatible with BMW models: Compatible with ActiveHybrid 7-2013...",
"initial_price": 17.99,
"currency": "USD"
},
{
"db_source": "1788950830367",
"timestamp": "2026-09-09",
"title": "Kurgo Big Baxter Dog Backpack Harness, Chili\/Barn Red",
"seller_name": null,
"brand": "Kurgo",
"description": "Get Fido packed up and ready to go with this lightweight, tough, custom-fit Baxter Dog Pack. Great for everyday use or b...",
"initial_price": null,
"currency": "USD"
},
{
"db_source": "1788950830367",
"timestamp": "2026-09-09",
"title": "PetSafe Healthy Pet Simply Feed Auto Feeder, Programmable, Holds 24 Cups",
"seller_name": "Ama***.co***",
"brand": "PetSafe",
"description": "Say goodbye to the early morning wake up meow or nose boop. The Healthy Pet Simply Feed will serve your pet breakfast so...",
"initial_price": 82.99,
"currency": "USD"
}
]
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.walmart.com/ip/Hershey-s-Kit-Kat-And-Reese-s-Assorted-Flavored-Candy-Party-Pack-33-38-oz/466623588?athbdg=L1600\u0026adsRedirect=true","zipcode":""},{"url":"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l95fol7l1ru6rlo116&format=json&uncompressed_webhook=true"
Response payload
[
{
"db_source": "1788601597750",
"timestamp": "2026-09-05",
"url": "https:\/\/www.walmart.com\/ip\/YFYANG-Round-Fitted-Table-Cloth-Waterproof-Purple-Flower-Art-Pattern-Polyester-Table-Cover-In...",
"final_price": 21.52,
"sku": "5522827011",
"currency": "USD",
"gtin": "694562468493",
"specifications": [
{
"name": "Size",
"value": "M (Fits 45-50in Round Table)"
},
{
"name": "Shape",
"value": "Round"
},
{
"name": "Color",
"value": "Multicolor"
},
{
"name": "Material",
"value": "Polyester"
},
{
"name": "Features",
"value": "Machine Washable, Waterproof"
},
{
"name": "Pattern",
"value": "Purple Flower Art"
},
{
"name": "Brand",
"value": "YFYANG"
},
{
"name": "Rec location",
"value": "Indoor, Outdoor"
}
]
},
{
"db_source": "1788601597750",
"timestamp": "2026-09-05",
"url": "https:\/\/www.walmart.com\/ip\/Transparent-Acrylic-Ice-Bucket-With-Clip-For-Hosting-Parties-At-Home-And-Bars\/20114005357",
"final_price": 12.99,
"sku": "20114005357",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Brand",
"value": "Handied"
},
{
"name": "Dimensions",
"value": "23.00 x 16.00 x 14.00 cm"
},
{
"name": "Weight",
"value": "0.98 lb"
},
{
"name": "Has written warranty",
"value": "No"
}
]
},
{
"db_source": "1788601597750",
"timestamp": "2026-09-05",
"url": "https:\/\/www.walmart.ca\/fr\/ip\/D-bardeur-encolure-d-gag-e-Lane-Bryant-Plus-pour-femmes\/6US9CUOUEI20",
"final_price": 4,
"sku": "6US9CUOUEI20",
"currency": "CAD",
"gtin": "197579997982",
"specifications": [
{
"name": "Features",
"value": "Respirant,Étirer"
},
{
"name": "Taille de vêtement",
"value": "5X"
},
{
"name": "Taille",
"value": "5X"
},
{
"name": "Nom de la marque",
"value": "Lane Bryant"
},
{
"name": "Sexe",
"value": "Féminin"
},
{
"name": "Catégorie de vêtement",
"value": "Femmes – tailles Plus"
},
{
"name": "Couleur",
"value": "bleu"
},
{
"name": "SKU",
"value": "6US9CUOUEI20"
}
]
},
{
"db_source": "1788601597750",
"timestamp": "2026-09-05",
"url": "https:\/\/www.walmart.ca\/fr\/ip\/Vernis-ongles-Insta-Dri-formule-3-en-1-avec-vernis-ongles-et-couche-de-finition-1-Trait-1-C...",
"final_price": 8.98,
"sku": "6000203594436",
"currency": "CAD",
"gtin": "3616302893324",
"specifications": [
{
"name": "Features",
"value": "Séchage rapide"
},
{
"name": "Nom de la marque",
"value": "Sally Hansen"
},
{
"name": "Catégorie de couleur",
"value": "Multicolore"
},
{
"name": "Type de vernis à ongles",
"value": "Vernis à ongles"
},
{
"name": "SKU",
"value": "6000203594436"
},
{
"name": "Code universel de produit (contrôle du CUP)",
"value": "3616302893324"
},
{
"name": "N° d’article Walmart",
"value": "30764753"
}
]
},
{
"db_source": "1788601597750",
"timestamp": "2026-09-05",
"url": "https:\/\/www.walmart.ca\/fr\/ip\/Kilougeis-Poign-es-d-Oreille-12-Paires-Crochet-en-Silicone-Anti-Support-Manchon-de-Prise-po...",
"final_price": 6.99,
"sku": "5Z2NEM82SL6U",
"currency": "CAD",
"gtin": "05306004982447",
"specifications": [
{
"name": "Nom de la marque"
},
{
"name": "Couleur",
"value": "J"
},
{
"name": "SKU",
"value": "5Z2NEM82SL6U"
},
{
"name": "Code universel de produit (contrôle du CUP)",
"value": "05306004982447"
}
]
}
]
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":"01011"},{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":""},{"url":"https://www.target.com/p/women-s-long-sleeve-shrunken-rib-t-shirt-universal-thread/-/A-88552173?preselect=88471695#lnk=sametab","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_ltppk5mx2lp0v1k0vo&format=json&uncompressed_webhook=true"
Response payload
[
{
"db_source": "1788605728044",
"timestamp": "2026-09-05",
"url": "https:\/\/www.target.com\/p\/cap-barbell-dumbbell-storage-weight-rack-black\/-\/A-85339618",
"product_id": "85339618",
"title": "CAP Barbell Dumbbell Storage Weight Rack - Black",
"product_description": "The CAP Barbell RK-24D-2J 24” Dumbbell Storage Rack is designed to handle weight safely and securely. Engineered with co...",
"rating": 4.12,
"reviews_count": 9
},
{
"db_source": "1788605728044",
"timestamp": "2026-09-05",
"url": "https:\/\/www.target.com\/p\/boy-s-star-wars-obi-wan-kenobi-darth-vader-strong-is-the-dark-side-silhouette-t-shirt\/-\/A-86827...",
"product_id": "86827005",
"title": "Boy\u0027s Star Wars: Obi-Wan Kenobi Darth Vader Strong is the Dark Side Silhouette T-Shirt - Kelly Green - Large",
"product_description": "Join Jedi Master Obi-Wan Kenobi as he deals with his apprentice, Anakin Skywalker, turning to the dark side and becoming...",
"rating": 0,
"reviews_count": 0
},
{
"db_source": "1788605728044",
"timestamp": "2026-09-05",
"url": "https:\/\/www.target.com\/p\/men-s-the-simpsons-ralph-and-his-cat-long-sleeve-shirt\/-\/A-87917262",
"product_id": "87917266",
"title": "Men\u0027s The Simpsons Ralph and His Cat Long Sleeve Shirt - Athletic Heather - 2X Large",
"product_description": "Mhmmm donuts… mhmm officially licensed The Simpsons styles. Show off your favorite animated series with hilarious offici...",
"rating": 4,
"reviews_count": 1
},
{
"db_source": "1788605728044",
"timestamp": "2026-09-05",
"url": "https:\/\/www.target.com\/p\/juniors-womens-marvel-avengers-avengers-infinity-war-gauntlet-sparkle-racerback-tank-top\/-\/A-87...",
"product_id": "87022943",
"title": "Juniors Womens Marvel Avengers: Avengers: Infinity War Gauntlet Sparkle Racerback Tank Top - Black - 2X Large",
"product_description": "The world needs all the help it can get going up against the Infinity Gauntlet and the Marvel Avengers: Infinity War Gau...",
"rating": 0,
"reviews_count": 0
},
{
"db_source": "1788605728044",
"timestamp": "2026-09-05",
"url": "https:\/\/www.target.com\/p\/maxi-cosi-tanza-belt-positioning-booster-car-seat\/-\/A-1010363559",
"product_id": "1010363559",
"title": "Maxi-Cosi Tanza Belt-Positioning Booster Car Seat",
"product_description": "The Tanza Belt-Positioning Booster Car Seat features a machine-washable foam seat pad and an adjustable 10-position head...",
"rating": 4.73,
"reviews_count": 29
}
]所需的一切，均已内置
你只为结果付费。代理、渲染、并发和交付始终包含在每个方案中。
直达数据源
每个请求都运行在 Bright Data 基础设施上。400M+ IP、解锁和浏览器均已内置。
即时扩展到数百万页面
发送无限并发请求 - 无需管理基础设施，无需更改配置。
网站变化时爬虫工具会自动修复
AI 驱动的自修复能力可检测网站变化并修复爬虫工具。你的管道持续运行。
数千个已验证爬虫工具
每个爬虫工具均由 Bright Data 构建、测试和维护。无需依赖社区猜测。
按结果付费，无额外费用
每条记录一个价格。代理、重试、渲染、解锁 - 全部包含，无隐藏费用。
合规且提供全面支持
符合 GDPR 和 CCPA。每个方案均提供 7*24 小时人工支持，包括免费方案。
几分钟内开始采集 数据
从代码调用 API、通过控制面板点击运行，或交给你的 AI 智能体。
引领合规网页数据采集实践
仅限公开可用数据。ISO 27001 认证、SOC 2 控制、符合 GDPR 和 CCPA。每个使用场景均由专属合规与伦理团队审核，并由有文档记录的 Know Your Customer 流程和可接受使用政策提供支持。
适用于各种使用场景的爬虫 API
针对开发者最常使用的行业和工作流优化的预构建爬虫工具。
Google 抓取 API
采集 Google Maps、Google Flights、Google Shopping 等数据。提取企业列表、评论、评分和本地 SEO 数据。
商业与 B2B 抓取 API
从 Linkedln、Crunchbase 和 Glassdoor 获取公司数据、职位列表、融资轮次和员工信息，丰富销售线索。助力 CRM 丰富、竞争情报和市场地图构建。
LLM 抓取 API
采集 ChatGTP、Gemini、Perplexity 和 CoPilot 数据。获取响应、用户查询、来源、链接、排名和竞争对手数据。
基于代理的爬虫工具 vs. 网页爬虫工具 API
Auto Scale
Persistent Sessions
Unblock any website
Flexible API & Tools
Fully Complaint
Bright Data
网页爬虫工具 API 常见问题
什么是网页爬虫工具 API？
网页爬虫工具 API 是一项基于云的服务，可简化网页数据提取，并自动处理 IP 轮换、CAPTCHA 解决以及将数据解析为结构化格式。它支持高效、可扩展的数据采集，专为需要无缝访问高价值网页数据的企业而打造。
谁可以从使用网页爬虫工具 API 中受益？
寻求高效方式来采集和分析网页数据，用于 AI、ML、大数据应用等场景的数据分析师、科学家、工程师和开发者，都将从网页爬虫工具 API 中获得显著价值。
为什么选择网页爬虫工具 API，而不是手动抓取方式？
网页爬虫工具 API 克服了手动网页抓取的限制，例如应对网站结构变化、遭遇封锁和 CAPTCHA，以及基础设施维护带来的高成本。它为数据提取提供自动化、可扩展且可靠的解决方案，显著降低运营成本和时间。
Bright Data 的网页爬虫工具 API 在市场上有何独特之处？
网页爬虫工具 API 的独特性在于其专业功能，例如批量请求处理、数据发现和自动验证，并由住宅代理和 JavaScript 渲染等先进技术提供支持。这些能力确保广泛访问、维持高数据完整性并提升整体效率，使爬虫 API 在竞争格局中脱颖而出。
如何开始使用网页爬虫工具 API？
通过 Bright Data 控制面板开始使用网页爬虫工具 API 非常简单，该控制面板提供全面文档和易用仪表盘，用于 API key 管理和设置。这种方式最大限度减少设置要求，让你能够立即访问一个高度可扩展且可靠的平台，满足网页数据提取需求。
网页爬虫工具 API 针对哪些具体使用场景进行了优化？
网页爬虫工具 API 支持一系列开发需求，包括竞争对标、市场趋势分析、动态定价算法、情感提取，以及将数据输入机器学习管道。对于电商、金融科技和社交媒体分析至关重要，这些 API 能帮助开发者有效实施数据驱动策略。
网页爬虫工具 API 如何管理大规模数据提取任务？
凭借高并发和批处理能力，网页爬虫工具 API 在大规模数据提取场景中表现出色。这确保开发者能够高效扩展抓取操作，以高吞吐量处理海量请求。
网页爬虫工具 API 可以以哪些数据格式提供提取的信息？
网页爬虫工具 API 以多种灵活格式交付提取数据，包括 NDJSON 和 CSV，确保与各类分析工具和数据处理工作流无缝集成，从而便于在开发者环境中采用。