- 使用任意语言构建请求
- 使用调度器和 webhook 自动化
- 支持 JSON、NDJSON 或 CSV 交付
网页爬虫工具 API 库
网页爬虫工具 API 定价
只为成功交付的内容付费。无隐藏费用,交付失败不收费。
- 只为成功结果付费,无隐藏费用
- 每月 5,000 个免费 credits,免费开始
- 无需预先承诺,可随时取消
- 7*24 小时专家支持和企业级功能
3 步从零开始获取数据
-
选择一个爬虫工具
从上方的 [current_scraper_name} 爬虫工具中选择,或在几分钟内用 AI 创建你自己的爬虫工具。
-
调用 API
一次 API 调用最多支持 5,000 个目标 URL。可使用 Python 和 Node.js SDK、CLI、MCP 服务器或任意 HTTP 客户端。
-
获取结构化数据
接收干净、已解析的 [current_scrper_name] 数据,格式支持 JSON、NDJSON 或 CSV。可通过 API、webhook 或云存储交付。
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","asin":"B0CRMZHDG8","origin_url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","zipcode":"94107","language":""},{"url":"https://www.amazon.com/KitchenAid-Protective-Dishwasher-Stainless-8-72-Inch/dp/B07PZF3QS3","asin":"B07PZF3QS3","zipcode":"","language":""},{"url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","asin":"","origin_url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","zipcode":"94124","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l7q7dkf244hwjntr0&format=json&uncompressed_webhook=true"
[
{
"timestamp": "2026-10-14",
"title": "IMPASSE 9: ESCUELAS DE FORMACION DE COMISARIOS: PERSPECTIVAS Y DE CEPCIONES",
"seller_name": null,
"brand": "VVAA",
"description": null,
"initial_price": null,
"currency": "USD",
"availability": null
},
{
"timestamp": "2026-10-14",
"title": "Pizarro (Art Library) (2010) ISBN: 489013641X [Japanese Import]",
"seller_name": null,
"brand": "Christopher Lloyd",
"description": "Camille Pissarro (1830-1903) was not only a central figure in the Impressionist movement but a major influence on the de...",
"initial_price": null,
"currency": "USD",
"availability": "Currently unavailable. We don\u0027t know when or if this item will be back in stock."
},
{
"timestamp": "2026-10-14",
"title": "Cleared for Takeoff (Funcles \u0026 Faunties™)",
"seller_name": null,
"brand": "Mary Moccia, Jessica Gamboa",
"description": "Cleared for Takeoff is the first book in the Funcles \u0026 Faunties™ series, celebrating the bonds between two curious child...",
"initial_price": 2.99,
"currency": "USD",
"availability": null
},
{
"timestamp": "2026-10-14",
"title": "Shanghai · English exam - 上海中考·英语",
"seller_name": "Chinese C*****e S***e **",
"brand": "水纯",
"description": "《上海中考》系列一共涉及语文、数学、英语、化学和物理五个科目。每科目图书分两册:一册为讲解篇,全面讲解中考考点,并配有经典例题讲解和少量针对性习题;另一册为集训篇,按讲解的考点顺序安排强化练习,巩固考点。两册图书配合使用,适合中考第-轮复习...",
"initial_price": 59.58,
"currency": "USD",
"availability": "Only 1 left in stock - order soon."
},
{
"timestamp": "2026-10-14",
"title": "Los costes del nuevo procedimiento concursal (Spanish Edition)",
"seller_name": "Cho***ook***",
"brand": "María Ull",
"description": null,
"initial_price": null,
"currency": "USD",
"availability": "Only 1 left in stock - order soon."
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.walmart.com/ip/Hershey-s-Kit-Kat-And-Reese-s-Assorted-Flavored-Candy-Party-Pack-33-38-oz/466623588?athbdg=L1600\u0026adsRedirect=true","zipcode":""},{"url":"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l95fol7l1ru6rlo116&format=json&uncompressed_webhook=true"
[
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.walmart.com\/ip\/Happy-Birthday-Cute-Kitten-Persian-with-Cake-Gifts-Party-Hat-Travel-Luggage-Cover-Cat-Lover-K...",
"final_price": 25.99,
"sku": "17403703467",
"currency": "USD",
"gtin": "450434865186",
"specifications": [
{
"name": "Brand",
"value": "Ninety3POD"
},
{
"name": "Luggage \u0026 luggage set type",
"value": "Lightweight Luggage"
},
{
"name": "Carry-on size",
"value": "Y"
},
{
"name": "Luggage \u0026 luggage set style",
"value": "Hardside"
},
{
"name": "Piece count",
"value": "1"
},
{
"name": "Color",
"value": "Multicolor"
},
{
"name": "Weight",
"value": "0.4 lb"
},
{
"name": "Carrying type",
"value": "Rolling"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Happy-Birthday-Cute-Kitten-Persian-with-Cake-Gifts-Party-Hat-Travel-Luggage-Cover-Cat-L...",
"https:\/\/i5.walmartimages.com\/asr\/a6c4aa44-4c1e-41e0-852c-53097ceeeac6.d8d561385b30221ed2da329bb373a8b8.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/ccf81639-e80c-4942-b48c-f36fbe78dfe8.7c97c90e3daab05593cd101614343a40.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/1eda0c05-8d47-4524-b68f-e32db8fdb434.0e882dc1e88a09c070c5859573ba0a7f.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/01d5240c-6735-4995-b955-479d07b45ae5.57f725bad33616bc9ef33389a8702438.jpeg"
]
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.walmart.com\/ip\/Borla-140930-ATAK-Series-Cat-Back-System-EXHAUST-SYSTEM\/5694353392",
"final_price": 2205.99,
"sku": "5694353392",
"currency": "USD",
"gtin": "808422409308",
"specifications": [
{
"name": "Vehicle fitment type",
"value": "Specific"
},
{
"name": "Vehicle type",
"value": "Car, Truck"
},
{
"name": "Brand",
"value": "BORLA"
},
{
"name": "Material",
"value": "Stainless Steel"
},
{
"name": "Finish",
"value": "Polished"
},
{
"name": "Weight",
"value": "52.1 lb"
},
{
"name": "Has written warranty",
"value": "No"
},
{
"name": "Count ",
"value": "1"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Borla-140930-ATAK-Series-Cat-Back-System-EXHAUST-SYSTEM_1f7c6e02-c401-44fd-9558-88e6681...",
"https:\/\/i5.walmartimages.com\/asr\/f96c1e11-0627-4e2f-b418-eef32b8937e7.6ceaf10eb7ba374598c1ef11ce6b0adc.jpeg"
]
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.walmart.com\/ip\/Lenpel-Women-s-Plus-Size-Shorts-Lightweight-Elastic-High-Waisted-Drawstring-Comfy-Lounge-Shor...",
"final_price": 10.99,
"sku": "16123361234",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Gender",
"value": "Female"
},
{
"name": "Clothing size group",
"value": "Women\u0027s Plus"
},
{
"name": "Age group",
"value": "Adult"
},
{
"name": "Clothing size",
"value": "5XL"
},
{
"name": "Color",
"value": "Purple"
},
{
"name": "Shorts style",
"value": "Pleated"
},
{
"name": "Clothing fit",
"value": "Tight"
},
{
"name": "Brand",
"value": "Lenpel"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Lenpel-Women-s-Plus-Size-Shorts-Lightweight-Elastic-High-Waisted-Drawstring-Comfy-Loung...",
"https:\/\/i5.walmartimages.com\/asr\/775351f2-77fe-45c4-a03e-3461f03e1228.b1dab158f108ef4ec6afce3a233fa69e.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/a607cdcf-d6e0-4171-b37d-7df06cdb69ba.a440b9ee53ff4c67d1dfb4280461ec4f.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/67b31c30-4999-45fc-b65b-5f8eecdab2d9.e204fd2641c9c081ca867cd3ca8f2d6d.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/56d01cca-067c-40e0-9d7a-a3239b79280f.5b46490e0e84e8bd468aaeebcc583f8a.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/a7df1ea9-481a-400d-8c88-8f8265c335c5.fbf54fc7d100e87df9f2cb258731a463.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/889426e8-85fa-4b77-9dab-b72197ec74dd.166c805914fad051bbc73820ef67a950.jpeg"
]
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.walmart.com\/ip\/uni-ball-Vision-Elite-Liquid-Rollerball-Pen-Refills-Bold-Point-0-8-mm-Blue-Black-Ink-Pack-Of-...",
"final_price": 9.27,
"sku": "21464387",
"currency": "USD",
"gtin": "070530612349",
"specifications": [
{
"name": "Compatible pen types",
"value": "Ballpoint Pen"
},
{
"name": "Ink pen refill type",
"value": "Ballpoint Pen Refills"
},
{
"name": "Ink color",
"value": "Blue"
},
{
"name": "Pen point size",
"value": "0.8 mm"
},
{
"name": "Brand",
"value": "uniball"
},
{
"name": "Pen point style",
"value": "Bold"
},
{
"name": "Pen type",
"value": "Rollerball Pens"
},
{
"name": "Is erasable",
"value": "N"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/uni-ball-Vision-Elite-Liquid-Rollerball-Pen-Refills-Bold-Point-0-8-mm-Blue-Black-Ink-Pa...",
"https:\/\/i5.walmartimages.com\/asr\/cd7a50fe-8388-47aa-93ee-da5100b0101d.bd67a8cb5a183256069e602725c8e677.jpeg"
]
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.walmart.com\/ip\/Gesammelte-Novellen-in-Versen-1864-9781168425515\/993927263",
"final_price": 22.92,
"sku": "993927263",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Publication date",
"value": "September, 2010"
},
{
"name": "Author",
"value": "Heyse, Paul"
},
{
"name": "Book format",
"value": "Paperback"
},
{
"name": "Genre",
"value": "Literature \u0026 Fiction"
},
{
"name": "Pages",
"value": "266"
},
{
"name": "Age group",
"value": "Adult, Teen"
},
{
"name": "Fiction\/nonfiction",
"value": "Fiction"
},
{
"name": "Publisher",
"value": "KESSINGER PUB LLC"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Gesammelte-Novellen-in-Versen-1864-9781168425515_a0cf3373-2c5f-469a-ae01-a0cf9da6dbbc.d..."
]
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":"01011"},{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":""},{"url":"https://www.target.com/p/women-s-long-sleeve-shrunken-rib-t-shirt-universal-thread/-/A-88552173?preselect=88471695#lnk=sametab","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_ltppk5mx2lp0v1k0vo&format=json&uncompressed_webhook=true"
[
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.target.com\/p\/the-makers-by-genevieve-rosen-biller-bad-bad-threads-hardcover\/-\/A-93954575",
"product_id": "93954575",
"title": "The Makers - by Genevieve Rosen-Biller \u0026 Bed Bed Threads (Hardcover)",
"product_description": "\u003Cp\/\u003E\u003Cbr\u003E\u003C\/br\u003E\u003Cp\u003E\u003Cb\u003E About the Book \u003C\/b\u003E\u003C\/p\u003E\u003C\/br\u003E\u003C\/br\u003EThe Makers takes you to 50 inspiring home and studio tours nested ...",
"rating": 0,
"reviews_count": 0,
"initial_price": 45
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.target.com\/p\/northlight-11-pink-spring-floral-easter-bunny-figure\/-\/A-86956624",
"product_id": "86956624",
"title": "Northlight 11\u0022 Pink Spring Floral Easter Bunny Figure",
"product_description": "She\u0027s ready for the Spring season! Are you ready? Perk up your Easter and Spring decor with this adorable bunny decorati...",
"rating": 1,
"reviews_count": 1,
"initial_price": 19.49
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.target.com\/p\/an-introduction-to-theology-in-global-perspective-theology-in-global-perspectives-by-stephen-be...",
"product_id": "94030740",
"title": "An Introduction to Theology in Global Perspective - (Theology in Global Perspectives) by Stephen Bevans (Paperback)",
"product_description": "\u003Cp\/\u003E\u003Cbr\u003E\u003C\/br\u003E\u003Cp\u003E\u003Cb\u003E Book Synopsis \u003C\/b\u003E\u003C\/p\u003E\u003C\/br\u003E\u003C\/br\u003E\u003Cp\u003EThis highly praised text provides a contemporary and global pers...",
"rating": 0,
"reviews_count": 0,
"initial_price": 36
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.target.com\/p\/7-ft-vacation-pets-pawty-animals-hanging-cardstock-garland-decoration\/-\/A-1013409097",
"product_id": "1013409097",
"title": "7 ft. Vacation Pets Pawty Animals Hanging Cardstock Garland Decoration",
"product_description": "Bring tropical fun to your celebration with this Vacation Pets Pawty Animals Hanging Cardstock Garland Decoration! Featu...",
"rating": 0,
"reviews_count": 0,
"initial_price": 13.87
},
{
"timestamp": "2026-10-15",
"url": "https:\/\/www.target.com\/p\/meri-meri-santa-reindeer-christmas-cookie-cutters-pack-of-2\/-\/A-84717507",
"product_id": "84717507",
"title": "Meri Meri Santa \u0026 Reindeer Christmas Cookie Cutters (Pack of 2)",
"product_description": "Kids love to bake cookies, especially during the festive season. They will adore this charming cookie cutter set to crea...",
"rating": 4.67,
"reviews_count": 3,
"initial_price": 16
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=Shein&format=json&uncompressed_webhook=true"
[]
所需的一切,均已内置
直达数据源
即时扩展到数百万页面
网站变化时爬虫工具会自动修复
数千个已验证爬虫工具
按结果付费,无额外费用
合规且提供全面支持
几分钟内开始采集 数据
引领合规网页数据采集实践
仅限公开可用数据。ISO 27001 认证、SOC 2 控制、符合 GDPR 和 CCPA。每个使用场景均由专属合规与伦理团队审核,并由有文档记录的 Know Your Customer 流程和可接受使用政策提供支持。
适用于各种使用场景的爬虫 API
Google 抓取 API
商业与 B2B 抓取 API
LLM 抓取 API
基于代理的爬虫工具 vs. 网页爬虫工具 API
网页爬虫工具 API 常见问题
什么是网页爬虫工具 API?
网页爬虫工具 API 是一项基于云的服务,可简化网页数据提取,并自动处理 IP 轮换、CAPTCHA 解决以及将数据解析为结构化格式。它支持高效、可扩展的数据采集,专为需要无缝访问高价值网页数据的企业而打造。
谁可以从使用网页爬虫工具 API 中受益?
寻求高效方式来采集和分析网页数据,用于 AI、ML、大数据应用等场景的数据分析师、科学家、工程师和开发者,都将从网页爬虫工具 API 中获得显著价值。
为什么选择网页爬虫工具 API,而不是手动抓取方式?
网页爬虫工具 API 克服了手动网页抓取的限制,例如应对网站结构变化、遭遇封锁和 CAPTCHA,以及基础设施维护带来的高成本。它为数据提取提供自动化、可扩展且可靠的解决方案,显著降低运营成本和时间。
Bright Data 的网页爬虫工具 API 在市场上有何独特之处?
网页爬虫工具 API 的独特性在于其专业功能,例如批量请求处理、数据发现和自动验证,并由住宅代理和 JavaScript 渲染等先进技术提供支持。这些能力确保广泛访问、维持高数据完整性并提升整体效率,使爬虫 API 在竞争格局中脱颖而出。
如何开始使用网页爬虫工具 API?
通过 Bright Data 控制面板开始使用网页爬虫工具 API 非常简单,该控制面板提供全面文档和易用仪表盘,用于 API key 管理和设置。这种方式最大限度减少设置要求,让你能够立即访问一个高度可扩展且可靠的平台,满足网页数据提取需求。
网页爬虫工具 API 针对哪些具体使用场景进行了优化?
网页爬虫工具 API 支持一系列开发需求,包括竞争对标、市场趋势分析、动态定价算法、情感提取,以及将数据输入机器学习管道。对于电商、金融科技和社交媒体分析至关重要,这些 API 能帮助开发者有效实施数据驱动策略。
网页爬虫工具 API 如何管理大规模数据提取任务?
凭借高并发和批处理能力,网页爬虫工具 API 在大规模数据提取场景中表现出色。这确保开发者能够高效扩展抓取操作,以高吞吐量处理海量请求。
网页爬虫工具 API 可以以哪些数据格式提供提取的信息?
网页爬虫工具 API 以多种灵活格式交付提取数据,包括 NDJSON 和 CSV,确保与各类分析工具和数据处理工作流无缝集成,从而便于在开发者环境中采用。