126.7K+
11.8K+
- 使用任意语言构建请求
- 使用调度器和 webhook 自动化
- 支持 JSON、NDJSON 或 CSV 交付
网页爬虫工具 API 库
选择一个爬虫工具并调用。每个爬虫工具都会列出其输出字段、交付量和实时成功率。
网页爬虫工具 API 定价
仅为成功交付的内容付费。无隐藏费用，失败交付不收费。
我们接受这些支付方式:
工作原理
3 步从零开始获取数据
无需配置代理，无需管理基础设施。选择、调用并接收数据。
-
选择一个爬虫工具
从上方的 [current_scraper_name} 爬虫工具中选择，或在几分钟内用 AI 创建你自己的爬虫工具。
-
调用 API
一次 API 调用最多支持 5,000 个目标 URL。可使用 Python 和 Node.js SDK、CLI、MCP 服务器或任意 HTTP 客户端。
-
获取结构化数据
接收干净、已解析的 [current_scrper_name] 数据，格式支持 JSON、NDJSON 或 CSV。可通过 API、webhook 或云存储交付。
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","asin":"B0CRMZHDG8","origin_url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","zipcode":"94107","language":""},{"url":"https://www.amazon.com/KitchenAid-Protective-Dishwasher-Stainless-8-72-Inch/dp/B07PZF3QS3","asin":"B07PZF3QS3","zipcode":"","language":""},{"url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","asin":"","origin_url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","zipcode":"94124","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l7q7dkf244hwjntr0&format=json&uncompressed_webhook=true"
Response payload
[
{
"timestamp": "2026-09-17",
"title": "PEUTIER 3D Carved Tooth Fairy Box, Wood Tooth Storage Box for Lost Teeth",
"seller_name": "PAR***ON",
"brand": "PEUTIER",
"description": "About this item Package List: You will receive 1 piece of tooth fairy box, suitable for boys and girls who are changing ...",
"initial_price": 6.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "Cradle Cap Brush for Babies, Set of 5 Baby Bath Essentials with Bath Sponge Silicone Scrubber Long Handle Comb for Newbo...",
"seller_name": "******",
"brand": "YESYBC",
"description": "Gentle \u0026 Safe Grooming: This kit includes two bath sponges and bristle brushes, two silicone cradle cap brushes, and a f...",
"initial_price": 6.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "URMYWO Baby Tissue Box Toy - Montessori Baby Toys for 6-12 Months 1 Year Old Boy Girl - Soft Crinkle Sensory Toys for In...",
"seller_name": "******",
"brand": "URMYWO",
"description": "polyster Fun Montessori Toys: Babies and young children are naturally curious and inquisitive about the world around the...",
"initial_price": 9.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "Sesame Street Elmo’s Sing \u0026 Learn Playphone",
"seller_name": "Ama***.co***",
"brand": "Sesame Street",
"description": "Get ready for giggles and engaging conversation with the Sesame Street Sing and Learn Playphone. This pretend play phone...",
"initial_price": 36.57,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-09-17",
"title": "Mioglrie Toddler Baby Girl Fall Winter Clothes Long Sleeve Sweatsuit 3-24M",
"seller_name": "Baby M******e",
"brand": "Mioglrie",
"description": "Baby girl clothes is soft, comfortable and breathable, ensuring that your baby stays cozy all day long. Toddler girls sw...",
"initial_price": 24.98,
"currency": "USD",
"availability": "In Stock"
}
]
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.walmart.com/ip/Hershey-s-Kit-Kat-And-Reese-s-Assorted-Flavored-Candy-Party-Pack-33-38-oz/466623588?athbdg=L1600\u0026adsRedirect=true","zipcode":""},{"url":"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l95fol7l1ru6rlo116&format=json&uncompressed_webhook=true"
Response payload
[
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.walmart.com.mx\/ip\/Comedero-para-Mascotas-con-Inclinacion-de-15-y-Base-Antideslizante-Diseno-Antiderrames-par...",
"final_price": 150.32,
"sku": "00434191103117",
"currency": "MXN",
"gtin": "00434191103117",
"specifications": [
{
"name": "Tipo de animal",
"value": "Perro,Gato"
},
{
"name": "Peso del Producto Ensamblado",
"value": "0.08 kg"
},
{
"name": "Marca",
"value": "Shinwei"
},
{
"name": "Color",
"value": "Fresno #4"
},
{
"name": "Nombre del Fabricante",
"value": "Ofertas de la semana"
},
{
"name": "Dimensiones del producto ensamblado",
"value": "13.00 x 12.50 x 11.50 cm"
}
],
"image_urls": []
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.walmart.com\/ip\/biudgviw-Big-and-Tall-T-Shirts-for-Men-Comfy-Soft-Crewneck-Knit-Tops-Elastic-Casual-Short-Sle...",
"final_price": 5.99,
"sku": "18931063611",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Color",
"value": "Beige"
},
{
"name": "Clothing size",
"value": "XL"
},
{
"name": "Gender",
"value": "Male"
},
{
"name": "Brand",
"value": "biudgviw"
},
{
"name": "Clothing fit",
"value": "Oversized"
},
{
"name": "Clothing neck style",
"value": "Crew Neck"
},
{
"name": "Sleeve length style",
"value": "Short Sleeve"
},
{
"name": "Pattern",
"value": "Striped"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/biudgviw-Big-and-Tall-T-Shirts-for-Men-Comfy-Soft-Crewneck-Knit-Tops-Elastic-Casual-Sho...",
"https:\/\/i5.walmartimages.com\/asr\/f06ce2f3-13d6-4461-b5b9-075edd40e922.55414eea253a4eef07086b4fe7e95bb4.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/798c4ccc-877e-45e0-9496-105106b657d3.5fc20d5b383c45ce8feb3bdfe8297ee7.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/0c606170-d250-40ec-a917-78cfbf643670.df01f0fcfd2855be10a7fe46671fbb0d.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/76b146ac-246f-4ef2-bdf5-4581549bbefa.f56cfe828db5e89420219a5a3aca12f7.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/f64ea39d-b188-44ce-a938-96a6cce9df11.894a878ec85ba8f8efb53f7f3eb158b8.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/4e812327-95dc-4d6a-a12c-df9bd591c560.56c08d78b9d42fdb175356126ced21f7.jpeg"
]
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.walmart.com\/ip\/eos-Cashmere-Skin-Collection-Women-s-Shave-Butter-Vanilla-Cashmere-7-fl-oz\/1646366993",
"final_price": 7.97,
"sku": "1646366993",
"currency": "USD",
"gtin": "840044710899",
"specifications": [
{
"name": "Form",
"value": "Cream"
},
{
"name": "Gender",
"value": "Female"
},
{
"name": "Skin type",
"value": "All"
},
{
"name": "Skin care key benefits",
"value": "Hydrating, Moisturizing, Protecting, Softening, Soothing"
},
{
"name": "Ingredient preference",
"value": "Phthalate-Free, Paraben-Free, Gluten-Free"
},
{
"name": "Scent",
"value": "Vanilla Cashmere"
},
{
"name": "Ingredient properties",
"value": "Hypoallergenic"
},
{
"name": "Features",
"value": "Non-Greasy"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/eos-Cashmere-Skin-Collection-Women-s-Shave-Butter-Vanilla-Cashmere-7-fl-oz_3a8da319-565...",
"https:\/\/i5.walmartimages.com\/asr\/11bd532d-424f-40c6-9ff5-b6a3196a9561.3922b89e2f3a5b1a0923995adeda4e2d.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/e78b76cf-af4c-46c4-b62e-68e85d447e6f.4fa52c52229de572fb01238e01f2e1e7.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/9defe394-f284-4ead-be15-b19b897bbf15.88cde5499e8afaa7b9d5eab50cb0160d.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/a3cdeba9-63b7-454c-a232-ab1309e0114f.5269667cfa3fd8d5fe1a2d0a023c67a6.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/22b93c26-63e7-4427-9e83-35f0ab8f7681.24cd3cc14452ead4b5ff18536fc71374.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/010de0ea-ad9e-4948-aeb8-37177e7c0899.e6defe378ec313e3a55de885e9065b00.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/e7869abd-d87e-4558-a29a-deb7644c14cb.661ebf18296a194bb0eb2c85fad49e7f.jpeg"
]
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.walmart.com\/ip\/Dolkfu-Cute-Pjs-Sets-for-Women-Camisole-Solid-Loose-Scoop-Neck-Shorts-Set-Casual-Women-s-Nigh...",
"final_price": 7.68,
"sku": "17509411537",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Clothing size",
"value": "M"
},
{
"name": "Color",
"value": "Gray"
},
{
"name": "Clothing fit",
"value": "Loose"
},
{
"name": "Pajama type",
"value": "Sleepwear Sets"
},
{
"name": "Sleeve length style",
"value": "Sleeveless"
},
{
"name": "Pant leg length",
"value": "Short"
},
{
"name": "Pieces",
"value": "1"
},
{
"name": "Brand",
"value": "DOLKFU"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Dolkfu-Cute-Pjs-Sets-for-Women-Camisole-Solid-Loose-Scoop-Neck-Shorts-Set-Casual-Women-...",
"https:\/\/i5.walmartimages.com\/asr\/4bd55c26-17f0-41d4-b226-a8a41190d4fd.409d20bd4cb20399db6e54086509b150.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/6a76efb2-31b3-4334-907d-400af1410845.f002303e6a9d57fd1f187d321d0ceb64.jpeg"
]
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.walmart.ca\/fr\/ip\/T-l-phone-Intelligent-D-verrouill-Samsung-Galaxy-Z-Flip3-5G-128-Go-Remis-Neuf-Bon\/5YSDDWAO5...",
"final_price": 344.99,
"sku": "5YSDDWAO5WJN",
"currency": "CAD",
"gtin": "00741527622206",
"specifications": [
{
"name": "Fonctionnalité du téléphone"
},
{
"name": "Plan de service cellulaire",
"value": "Appareil sans abonnement déverrouillé"
},
{
"name": "Nom de la marque"
},
{
"name": "Cell Phone Type"
},
{
"name": "Fournisseur de services de téléphonie mobile"
},
{
"name": "Dimension de l’écran",
"value": "6.7 in"
},
{
"name": "Mégapixels de l’appareil photo avant",
"value": "10 MP"
},
{
"name": "Mégapixels de l’appareil photo arrière",
"value": "12 MP"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.ca\/asr\/4e73f10d-807d-4063-b819-a6dc22368794.f477649950a04ed2412e1ae6bf22e312.jpeg",
"https:\/\/i5.walmartimages.ca\/asr\/dd34348d-145b-425c-93bc-8ec7dada1550.79db71d8a6acee7232165644435c395c.jpeg",
"https:\/\/i5.walmartimages.ca\/asr\/12fb52c7-5937-4564-b238-f1eddf3422a3.58bd3e70a416daba890fcd31be2ed619.png"
]
}
]
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":"01011"},{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":""},{"url":"https://www.target.com/p/women-s-long-sleeve-shrunken-rib-t-shirt-universal-thread/-/A-88552173?preselect=88471695#lnk=sametab","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_ltppk5mx2lp0v1k0vo&format=json&uncompressed_webhook=true"
Response payload
[
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.target.com\/p\/ncaa-texas-longhorns-men-39-s-champion-t-shirt-l\/-\/A-94715959",
"product_id": "94715959",
"title": "NCAA Texas Longhorns Men\u0027s Champion T-Shirt - L",
"product_description": "Elevate your everyday style with the unbeatable combination of comfort, quality, and authenticity with this officially l...",
"rating": 0,
"reviews_count": 0,
"initial_price": null
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.target.com\/p\/boys-the-mandalorian-where-dad-goes-i-go-long-sleeve-graphic-t-shirt-navy-medium\/-\/A-1006809151",
"product_id": "1006809151",
"title": "Boys\u0027 The Mandalorian Where Dad Goes I Go Long Sleeve Graphic T-Shirt - Navy - Medium",
"product_description": "The Mandalorian - Where Dad Goes I Go - Youth Long Sleeve Graphic T-Shirt - Embark on a legendary adventure with our off...",
"rating": 0,
"reviews_count": 0,
"initial_price": null
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.target.com\/p\/nfl-new-york-giants-women-39-s-cream-air-layer-crew-performance-top-l\/-\/A-95264464",
"product_id": "95264464",
"title": "NFL New York Giants Women\u0027s Cream Air Layer Crew Performance Top - L",
"product_description": null,
"rating": 0,
"reviews_count": 0,
"initial_price": 44.99
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.target.com\/p\/ncaa-nebraska-cornhuskers-men-39-s-big-and-tall-gray-hoodie-4x\/-\/A-86847507",
"product_id": "86847507",
"title": "NCAA Nebraska Cornhuskers Men\u0027s Big and Tall Gray Hoodie - 4X: Team Logo Pullover",
"product_description": "Show your team pride in this authentic Nebraska Cornhusker super soft Big and Tall fleece hoodie, officially licensed Co...",
"rating": 1,
"reviews_count": 1,
"initial_price": 49.99
},
{
"timestamp": "2026-09-17",
"url": "https:\/\/www.target.com\/p\/ncaa-south-carolina-gamecocks-youth-poly-sweatshirt-l\/-\/A-95158127",
"product_id": "95158127",
"title": "NCAA South Carolina Gamecocks Youth Poly Sweatshirt - L",
"product_description": "Sporty and comfortable, this Pullover Hoodie features a team color body with a fun contrast hood lining. This hoodie is ...",
"rating": 0,
"reviews_count": 0,
"initial_price": 34.99
}
]所需的一切，均已内置
你只为结果付费。代理、渲染、并发和交付始终包含在每个方案中。
直达数据源
每个请求都运行在 Bright Data 基础设施上。400M+ IP、解锁和浏览器均已内置。
即时扩展到数百万页面
发送无限并发请求 - 无需管理基础设施，无需更改配置。
网站变化时爬虫工具会自动修复
AI 驱动的自修复能力可检测网站变化并修复爬虫工具。你的管道持续运行。
数千个已验证爬虫工具
每个爬虫工具均由 Bright Data 构建、测试和维护。无需依赖社区猜测。
按结果付费，无额外费用
每条记录一个价格。代理、重试、渲染、解锁 - 全部包含，无隐藏费用。
合规且提供全面支持
符合 GDPR 和 CCPA。每个方案均提供 7*24 小时人工支持，包括免费方案。
几分钟内开始采集 数据
从代码调用 API、通过控制面板点击运行，或交给你的 AI 智能体。
引领合规网页数据采集实践
仅限公开可用数据。ISO 27001 认证、SOC 2 控制、符合 GDPR 和 CCPA。每个使用场景均由专属合规与伦理团队审核，并由有文档记录的 Know Your Customer 流程和可接受使用政策提供支持。
适用于各种使用场景的爬虫 API
针对开发者最常使用的行业和工作流优化的预构建爬虫工具。
Google 抓取 API
采集 Google Maps、Google Flights、Google Shopping 等数据。提取企业列表、评论、评分和本地 SEO 数据。
商业与 B2B 抓取 API
从 Linkedln、Crunchbase 和 Glassdoor 获取公司数据、职位列表、融资轮次和员工信息，丰富销售线索。助力 CRM 丰富、竞争情报和市场地图构建。
LLM 抓取 API
采集 ChatGTP、Gemini、Perplexity 和 CoPilot 数据。获取响应、用户查询、来源、链接、排名和竞争对手数据。
基于代理的爬虫工具 vs. 网页爬虫工具 API
Auto Scale
Persistent Sessions
Unblock any website
Flexible API & Tools
Fully Complaint
Bright Data
网页爬虫工具 API 常见问题
什么是网页爬虫工具 API？
网页爬虫工具 API 是一项基于云的服务，可简化网页数据提取，并自动处理 IP 轮换、CAPTCHA 解决以及将数据解析为结构化格式。它支持高效、可扩展的数据采集，专为需要无缝访问高价值网页数据的企业而打造。
谁可以从使用网页爬虫工具 API 中受益？
寻求高效方式来采集和分析网页数据，用于 AI、ML、大数据应用等场景的数据分析师、科学家、工程师和开发者，都将从网页爬虫工具 API 中获得显著价值。
为什么选择网页爬虫工具 API，而不是手动抓取方式？
网页爬虫工具 API 克服了手动网页抓取的限制，例如应对网站结构变化、遭遇封锁和 CAPTCHA，以及基础设施维护带来的高成本。它为数据提取提供自动化、可扩展且可靠的解决方案，显著降低运营成本和时间。
Bright Data 的网页爬虫工具 API 在市场上有何独特之处？
网页爬虫工具 API 的独特性在于其专业功能，例如批量请求处理、数据发现和自动验证，并由住宅代理和 JavaScript 渲染等先进技术提供支持。这些能力确保广泛访问、维持高数据完整性并提升整体效率，使爬虫 API 在竞争格局中脱颖而出。
如何开始使用网页爬虫工具 API？
通过 Bright Data 控制面板开始使用网页爬虫工具 API 非常简单，该控制面板提供全面文档和易用仪表盘，用于 API key 管理和设置。这种方式最大限度减少设置要求，让你能够立即访问一个高度可扩展且可靠的平台，满足网页数据提取需求。
网页爬虫工具 API 针对哪些具体使用场景进行了优化？
网页爬虫工具 API 支持一系列开发需求，包括竞争对标、市场趋势分析、动态定价算法、情感提取，以及将数据输入机器学习管道。对于电商、金融科技和社交媒体分析至关重要，这些 API 能帮助开发者有效实施数据驱动策略。
网页爬虫工具 API 如何管理大规模数据提取任务？
凭借高并发和批处理能力，网页爬虫工具 API 在大规模数据提取场景中表现出色。这确保开发者能够高效扩展抓取操作，以高吞吐量处理海量请求。
网页爬虫工具 API 可以以哪些数据格式提供提取的信息？
网页爬虫工具 API 以多种灵活格式交付提取数据，包括 NDJSON 和 CSV，确保与各类分析工具和数据处理工作流无缝集成，从而便于在开发者环境中采用。