如果你不知道从哪里入手,Walmart 可能是一个很难爬虫的网站。不过,有了合适的工具,你可以在几分钟内像专业人士一样爬虫 Walmart。
在本指南中,你将学习如何使用以下方法爬虫 Walmart。
- 手动爬虫 Walmart。
- 通过 Bright Data 的 Walmart 爬虫工具 API 爬虫 Walmart。
- 使用 Claude 和 Bright Data MCP 服务器爬虫 Walmart。
为什么要爬虫 Walmart?
Walmart 是全世界最大的零售商。在在线市场中,它们仅次于 Amazon。爬虫 Walmart 有大量理由。
无论你是在寻找最优惠的交易,还是在进行竞争对手分析,Walmart 都是购物数据的宝库。产品元数据、客户评价、价格波动和配送选项都可以获取——只要你知道在哪里找。
开发者、爱好者和无代码数据团队都可以轻松爬虫 Walmart。借助 Walmart 数据,你可以做出数据驱动的决策,为你的分析和应用程序赋能未来。
先决条件
开始本教程只需要几样东西。如果你只是为了 Python 部分或 AI 部分而来,可以随意跳到后面。本教程的所有部分都需要 Bright Data API 密钥。当然,只有当你以传统方式爬虫时才需要 Python。只有当你使用 AI 爬虫时才需要 Claude。
- Bright Data API 密钥:你需要一个 API 密钥才能使用 Bright Data 产品。注册免费试用即可开始。
- Python:如果你不熟悉 Python,别担心!从官方下载页面获取最新版本。按照你操作系统对应的说明操作。
- Claude 桌面应用程序: 它可在 Windows 和 mac 上这里下载。Claude 允许你使用 Model Context Protocol 接入第三方工具。
入门
在开始编码之前,你需要设置一个新的虚拟环境。
python -m venv venv
激活你的新环境。
source venv/bin/activate
安装 Requests 和 BeautifulSoup。
pip install requests beautifulsoup4
手动抓取
我们将向你展示如何在有代理和没有代理帮助的情况下手动抓取 Walmart。没有代理时,我们不断被阻止。也就是说,你仍然可以自己尝试。
不使用代理抓取
下面的代码包含我们的基础 Walmart 爬虫工具。它非常难找,但 Walmart 会将其产品数据嵌入页面上的一个 JSON blob 中。这些数据嵌入在一个 script 元素内,其 id 为 __NEXT_DATA__,type 为 application/json。我们使用这些特征来构建 CSS 选择器:script[id='__NEXT_DATA__']。
下面的代码很可能会失败。我们将响应写入一个 HTML 页面,这样当爬虫失败时,我们可以查看页面并了解发生了什么。
import requests
from bs4 import BeautifulSoup
import json
response = requests.get("https://www.walmart.com/search?q=laptops")
with open("response.html", "w") as file:
file.write(response.text)
extracted_data = []
soup = BeautifulSoup(response.text, "html.parser")
script_tag = soup.select_one("script[id='__NEXT_DATA__'][type='application/json']")
json_data = json.loads(script_tag.text)
item_list = json_data["props"]["pageProps"]["initialData"]["searchResult"]["itemStacks"][0]["items"]
for item in item_list:
if item["__typename"] != "Product":
continue
name = item.get("name")
product_id = item["usItemId"]
if not name:
continue
link = f"https://www.walmart.com/reviews/product/{product_id}"
price = item["price"]
sponsored = item["isSponsoredFlag"]
rating = item["averageRating"]
scraped_product = {
"name": name,
"stars": rating,
"url": link,
"sponsored": sponsored,
"price": price,
"product_id": product_id
}
extracted_data.append(scraped_product)
with open("unproxied-laptops.json", "w") as file:
json.dump(extracted_data, file, indent=4)
如果你运行上面的代码,很可能会被阻止。我们一直遇到这种情况。当我们在浏览器中打开 HTML 页面时,看到的是这样。我们的抓取工具显然已经被发现了——而且它没有办法越过这个页面。

使用代理抓取
在下一个代码示例中,我们使用相同的基础爬虫工具,但为其改装了 网络解锁器 API。使用此 API,我们会用 API 密钥和一些 API 参数发出 POST 请求。除此之外,我们的程序基本相同。请务必将 API 密钥和区域名称替换为你自己的。
我们不再需要将 HTML 写入单独的文件进行故障排查。代码按预期工作。
import requests
from bs4 import BeautifulSoup
import json
headers = {
"Authorization": "Bearer <your-bright-data-api-key>",
"Content-Type": "application/json"
}
data = {
"zone": "web_unlocker1",
"url": "https://www.walmart.com/search?q=laptops",
"format": "raw"
}
response = requests.post(
"https://api.brightdata.com/request",
json=data,
headers=headers
)
extracted_data = []
soup = BeautifulSoup(response.text, "html.parser")
script_tag = soup.select_one("script[id='__NEXT_DATA__'][type='application/json']")
json_data = json.loads(script_tag.text)
item_list = json_data["props"]["pageProps"]["initialData"]["searchResult"]["itemStacks"][0]["items"]
for item in item_list:
if item["__typename"] != "Product":
continue
name = item.get("name")
product_id = item["usItemId"]
if not name:
continue
link = f"https://www.walmart.com/reviews/product/{product_id}"
price = item["price"]
sponsored = item["isSponsoredFlag"]
rating = item["averageRating"]
scraped_product = {
"name": name,
"stars": rating,
"url": link,
"sponsored": sponsored,
"price": price,
"product_id": product_id
}
extracted_data.append(scraped_product)
with open("scraped-laptops.json", "w") as file:
json.dump(extracted_data, file, indent=4)
如果你运行代码,你将获得一个整洁的 JSON 文件,里面全是产品。下面的数据是有意截断的。我们只是想让你看到这种整洁的格式。
[
{
"name": "ASUS CX15 15.6 inch FHD IPS Chromebook Laptop Intel Celeron N4500 4GB RAM 128GB eMMC Pure Gray",
"stars": 4.3,
"url": "https://www.walmart.com/reviews/product/13722470932",
"sponsored": true,
"price": 159,
"product_id": "13722470932"
},
{
"name": "Dell Inspiron 14 Laptop 5440 14-inch FHD+ Intel Core i5-1334U 8GB RAM 512GB NVMe SSD Carbon Black",
"stars": 4.4,
"url": "https://www.walmart.com/reviews/product/8988969760",
"sponsored": true,
"price": 349,
"product_id": "8988969760"
},
这种 Walmart 抓取方法利用了 Bright Data 的住宅代理网络,使我们能够扩大被抓取 URL 的数量,同时保护自己免于被阻止。
爬虫工具 API
使用 Bright Data Walmart 爬虫工具 API,你实际上可以运行一个预构建的抓取工具,并按需触发采集。这非常适合你想要最少代码或重复采集以构建历史数据集的情况。我们在 “Walmart products search” 选项卡下选择了 “Collect by URL”。

现在,删除默认 URL,并将你选择的 URL 添加到请求构建器中。如果你使用的是 laptops,请复制并粘贴我们下面的 URL。
https://www.walmart.com/search?q=laptops

在请求构建器的右侧,你会看到一个自动生成的命令,你可以运行它。我们使用的是 Windows,因此复制并粘贴了下面的 Powershell 命令。选择最适合你的格式。
echo '[{"url":"https://www.walmart.com/search?q=laptops"}]' | curl.exe -H "Authorization: Bearer <your-bright-data-api-key>" -H "Content-Type: application/json" -d "@-" "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_m7khey0wb7wviejgj&include_errors=true"
如果你点击 “Logs” 选项卡,你将能够在日志中看到爬虫进度。当它准备好后,你将能够使用你选择的格式下载报告。

当报告下载完成后,你将获得一份巨大的 Walmart 产品报告。你可以选择格式。有多种 JSON 类型可用,也有 CSV 电子表格。
{"id":"53H3B7IK07HL","url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","typename":"Product","buy_box_suppression":false,"similar_items":false,"us_item_id":"13678864426","is_bad_split":false,"name":"HP 15.6 inch FHD IPS Windows Laptop Intel Core i7-1355U 16GB RAM 1TB PCIe NVMe SSD Natural Silver","check_store_availability_atc":false,"see_shipping_eligibility":false,"type":"VARIANT","weight_increment":1,"image_info":{"url":"https://i5.walmartimages.com/seo/HP-15-6-inch-Windows-Laptop-Intel-Core-i7-1355U-16GB-RAM-1TB-SSD-Natural-Silver_de82070a-d2bc-4ea4-bf42-3d1239d93e3d.be919c24e2f3dd7c97e5ccbd8970396a.jpeg?odnHeight=180&odnWidth=180&odnBg=FFFFFF","id":"E117356E0994479A9382100D3AB2B225","name":"HP-15-6-inch-Windows-Laptop-Intel-Core-i7-1355U-16GB-RAM-1TB-SSD-Natural-Silver_de82070a-d2bc-4ea4-bf42-3d1239d93e3d.be919c24e2f3dd7c97e5ccbd8970396a.jpeg","thumbnail_url":"https://i5.walmartimages.com/seo/HP-15-6-inch-Windows-Laptop-Intel-Core-i7-1355U-16GB-RAM-1TB-SSD-Natural-Silver_de82070a-d2bc-4ea4-bf42-3d1239d93e3d.be919c24e2f3dd7c97e5ccbd8970396a.jpeg?odnHeight=180&odnWidth=180&odnBg=FFFFFF","size":"104-104","all_images":[]},"aspect_info":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426"},"canonical_url":"https://www.walmart.com/ip/HP-15-6-inch-Windows-Laptop-Intel-Core-i7-1355U-16GB-RAM-1TB-SSD-Natural-Silver/13678864426?classType=VARIANT","category":{"url":"https://www.walmart.com/browse/3944_1089430_3951_8835131_1737838_1315601","category_path_id":"0:3944:1089430:3951:8835131:1737838:1315601"},"return_policy":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","return_window":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","unit_type":"Day"}},"badges":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","tags":[{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","__typename":"BaseBadge","key":"SAVE_WITH_W_PLUS","text":"Save with","type":"ICON"}],"groups":[{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","__typename":"UnifiedBadgeGroup","name":"fulfillment","members":[{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","__typename":"BadgeGroupMember","id":"L1052","key":"FF_DELIVERY","member_type":"badge","rank":1,"sla_text":"1 hour","style_id":"FF_STYLE_THUNDERBOLT","text":"Delivery as soon as "},{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","__typename":"BadgeGroupMember","id":"L1053","key":"FF_SHIPPING","member_type":"badge","rank":2,"sla_text":"tomorrow","style_id":"FF_STYLE","text":"Free shipping, arrives "},{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","__typename":"BadgeGroupMember","id":"L1051","key":"FF_PICKUP","member_type":"badge","rank":3,"sla_text":"7pm","style_id":"FF_STYLE","text":"Free pickup as soon as "}]}],"groups_v2":"[]"},"buy_now_eligible":true,"class_type":"VARIANT","average_rating":4.4,"number_of_reviews":115,"sales_unit_type":"EACH","seller_id":"F55CDC31AB754BB68FE0B39041159D63","seller_name":"Walmart.com","is_early_access_item":false,"pre_early_access_event":false,"early_access_event":false,"blitz_item":false,"annual_event":false,"annual_event_v2":false,"availability_status_v2":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","display":"In stock","value":"IN_STOCK"},"group_meta_data":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","number_of_components":0},"offer_id":"167D2663980D33B8A6EC1C096E9D7A16","pre_order":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","is_pre_order":false},"fulfillment_summary":[{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","fulfillment":"DELIVERY","store_id":"2108","fulfillment_methods":["UNSCHEDULED","SCHEDULED"]},{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","fulfillment":"PICKUP","store_id":"2108","delivery_date":"2026-07-21T23:00:00.000Z","fulfillment_methods":["UNSCHEDULED","SCHEDULED"]},{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","fulfillment":"DELIVERY","store_id":"0","delivery_date":"2026-07-22T21:59:00.000Z","fulfillment_methods":["UNSCHEDULED"]}],"price_info":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","item_price":"$959.99","line_price":"$619.00","line_price_display":"Now $619.00","savings":"SAVE $340.99","savings_amt":340.99,"was_price":"$959.99","min_price":433,"price_range_string":"Options from $433.00","final_cost_by_weight":false,"is_b2b_price":false},"variant_criteria":[],"snap_eligible":false,"fulfillment_type":"STORE","show_atc":false,"sponsored_product":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","sp_qs":"6zMQrU4FZVwFjcXr8O5NVyk0BiDLjp2NT_Z0lJtju-STWusrQcwJEDZNYI4-K6jzL9jWasEvGb0VgkggSzqdaz_6wmiULHw1KbykRca50297WyT-2Mocv3HA5PmRQImcjSlQgM_eTHWLnS5qfW7R4--zdmRPGUywkx0v5yDqIbFmyiqtH19U3gyALKHSadiKNcQvYifUHFIheHXj_Sqgswm4ujES3nBcldtxJkDTKRF6OnwqYSrVQCZBFN8Q7XIrVou3_w1O7zcNkYR_bljlY5J3mITg_xivqsJYeFpsNJI","click_beacon":"https://www.walmart.com/sp/track?adUid=9eb11e15-1abe-4caa-b684-3008c76d7bbf-0-0&pgId=laptops&spQs=6zMQrU4FZVwFjcXr8O5NVyk0BiDLjp2NT_Z0lJtju-STWusrQcwJEDZNYI4-K6jzL9jWasEvGb0VgkggSzqdaz_6wmiULHw1KbykRca50297WyT-2Mocv3HA5PmRQImcjSlQgM_eTHWLnS5qfW7R4--zdmRPGUywkx0v5yDqIbFmyiqtH19U3gyALKHSadiKNcQvYifUHFIheHXj_Sqgswm4ujES3nBcldtxJkDTKRF6OnwqYSrVQCZBFN8Q7XIrVou3_w1O7zcNkYR_bljlY5J3mITg_xivqsJYeFpsNJI&storeId=2108&pt=search&mloc=sp-search-middle&bkt=ace1_default%7Cace2_12171%7Cace3_default%7Ccoldstart_on%7Csearch_default&pltfm=desktop&rdf=0&plmt=__plmt__&eventST=__eventST__&pos=__pos__&bt=__bt__&tn=WMT&wtn=elh9ie&tax=3944_1089430_3951_8835131_1737838&et=head_torso&st=head"},"show_options":true,"show_buy_now":false,"ar_experiences":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","is_ar_home":false,"is_zeekit":false,"is_ar_optical":false},"event_attributes":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","price_flip":false,"special_buy":false},"subscription":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","__typename":"SubscriptionData","subscription_eligible":false,"show_subscription_cta":false},"has_care_plans":true,"pet_rx":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","eligible":false},"vision":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","vision_center_approved":false},"show_explore_other_conditions_cta":false,"is_preowned":false,"mhmd_flag":false,"see_similar":false,"availability_status_display_value":"In stock","product_location_display_value":"K13","can_add_to_cart":false,"badge":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426"},"fulfillment_badge_groups":[{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","text":"Delivery as soon as ","sla_text":"1 hour","is_sla_text_bold":true,"class_name":"w-fit items-center br1 ph1 bg-blue-130 white ff-thunderbolt","key":"FF_DELIVERY"},{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","text":"Free shipping, arrives ","sla_text":"tomorrow","is_sla_text_bold":true,"class_name":"dark-gray","key":"FF_SHIPPING"},{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","text":"Free pickup as soon as ","sla_text":"7pm","is_sla_text_bold":true,"class_name":"dark-gray","key":"FF_PICKUP"}],"fulfillment_icon":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","key":"SAVE_WITH_W_PLUS","label":"Save with"},"special_buy":false,"price_flip":false,"image":"https://i5.walmartimages.com/seo/HP-15-6-inch-Windows-Laptop-Intel-Core-i7-1355U-16GB-RAM-1TB-SSD-Natural-Silver_de82070a-d2bc-4ea4-bf42-3d1239d93e3d.be919c24e2f3dd7c97e5ccbd8970396a.jpeg?odnHeight=180&odnWidth=180&odnBg=FFFFFF","image_name":"HP-15-6-inch-Windows-Laptop-Intel-Core-i7-1355U-16GB-RAM-1TB-SSD-Natural-Silver_de82070a-d2bc-4ea4-bf42-3d1239d93e3d.be919c24e2f3dd7c97e5ccbd8970396a.jpeg","is_out_of_stock":false,"price":619,"rating":{"url":"https://www.walmart.com/ip/HP-156-inch-FHD-IPS-Windows-Laptop-Intel-Core-i71355U-16GB-RAM-1TB-PCIe-NVMe-SSD-Natural-Silver/13678864426","average_rating":4.4,"number_of_reviews":115},"sales_unit":"EACH","variant_list":[],"is_variant_type_swatch":false,"should_lazy_load":false,"is_sponsored_flag":true,"is_left_side_grid_item":"true","product_index":0,"item_stack_position":1,"page_number":5,"placement_on_page":1,"currency":"$","timestamp":"2026-07-21T19:40:28.632Z","input":{"url":"https://www.walmart.com/search?q=laptops"}}
使用 Claude 和 MCP 服务器爬虫 Walmart 数据
最后,你可以使用 Claude 和我们的 MCP 服务器 爬虫 Walmart。使用 Claude,你只需要设置 MCP 连接,然后让 LLM 接手即可。你实际上是在使用自然语言执行一次爬虫。
打开 Claude。接下来,点击 “File” 并打开你的设置。

在 “Developer Settings” 下,点击 “Edit Config” 并打开你的配置文件。将以下 JSON 复制并粘贴到你的配置文件中。请务必将占位符替换为你自己的 API 密钥。
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "<your-bright-data-api-key>"
}
}
}
}
一旦一切正常运行,进入你的开发者设置,你应该会看到类似以下的配置。

现在,只需让 Claude 执行抓取!就是这么简单。如果抓取失败,你遇到的是上下文限制。Walmart 产品页面非常庞大,而 Claude 的免费层级只提供有限的上下文窗口。通过升级到他们的专业计划来改善你的上下文窗口——我们必须这样做才能处理该页面。
Please extract laptops from the following url https://www.walmart.com/search?q=laptops.

爬虫完成后,Claude 会总结它在页面上找到的 laptops。

现在,只需让 Claude 将数据转换为 JSON 文件。
Please store all laptops in a json file. If possible and convenient for you, remove ads and duplicates please.

下面是 Claude 给我们的 JSON 文件。单页产品,包含极其详细的信息。Claude 还提到总共有 380 台 laptops。
你可以要求 Claude 爬虫全部 380 个。我们选择不这样做,因为这是一个演示。
{
"source": "Walmart.com",
"search_query": "laptops",
"extraction_date": "2026-07-21",
"total_results": 380,
"laptops": [
{
"id": 1,
"name": "HP 15.6 inch FHD IPS Windows Laptop Intel Core i7-1355U 16GB RAM 1TB PCIe NVMe SSD Natural Silver",
"brand": "HP",
"current_price": 619.00,
"original_price": 959.99,
"discount_percentage": 35.5,
"processor": "Intel Core i7-1355U",
"ram": "16GB",
"storage": "1TB PCIe NVMe SSD",
"screen_size": "15.6 inch",
"display_type": "FHD IPS",
"operating_system": "Windows",
"color": "Natural Silver",
"rating": 4.4,
"review_count": 115,
"features": ["FHD IPS Display", "High Performance"],
"category": "Windows Laptop",
"availability": "In Stock",
"shipping": "Free shipping, arrives today"
},
{
"id": 2,
"name": "SANPTENT 15.6 inch 1080p FHD Laptop Computer 16GB RAM 512GB SSD with 4 Core Intel Celeron N5095",
"brand": "SANPTENT",
"current_price": 279.99,
"original_price": 599.00,
"discount_percentage": 53.3,
"processor": "Intel Celeron N5095 (4 Core)",
"ram": "16GB",
"storage": "512GB SSD",
"screen_size": "15.6 inch",
"display_type": "1080p FHD",
"operating_system": "Windows 11 Pro",
"color": "Not specified",
"rating": 4.4,
"review_count": 890,
"features": ["Fingerprint Reader", "Backlit Keyboard", "Windows 11 Pro"],
"category": "Windows Laptop",
"availability": "In Stock",
"shipping": "Free shipping, arrives tomorrow"
},
{
"id": 3,
"name": "ASUS CX15 15.6 inch FHD IPS Chromebook Laptop Intel Celeron N4500 4GB RAM 128GB eMMC Fabric Blue",
"brand": "ASUS",
"current_price": 159.00,
"original_price": 219.99,
"discount_percentage": 27.7,
"processor": "Intel Celeron N4500",
"ram": "4GB",
"storage": "128GB eMMC",
"screen_size": "15.6 inch",
"display_type": "FHD IPS",
"operating_system": "Chrome OS",
"color": "Fabric Blue",
"rating": 4.3,
"review_count": 484,
"features": ["NanoEdge Display", "Pure Gray option available"],
"category": "Chromebook",
"availability": "In Stock",
"shipping": "Free shipping, arrives today"
},
{
"id": 4,
"name": "Apple MacBook Air 13.3 inch Laptop - Space Gray, M1 Chip, Built for Apple Intelligence, 8GB RAM, 256GB storage",
"brand": "Apple",
"current_price": 599.00,
"original_price": 649.00,
"discount_percentage": 7.7,
"processor": "Apple M1 Chip",
"ram": "8GB",
"storage": "256GB",
"screen_size": "13.3 inch",
"display_type": "Retina",
"operating_system": "macOS",
"color": "Space Gray",
"rating": 4.7,
"review_count": 6428,
"features": ["Built for Apple Intelligence", "M1 Chip", "Multiple color options"],
"category": "MacBook",
"availability": "In Stock",
"shipping": "Free shipping, arrives tomorrow",
"color_options": ["Space Gray", "Silver", "Gold"]
},
{
"id": 5,
"name": "HP 15.6 inch Windows Touch Laptop Intel Core i3-N305 8GB RAM 256GB SSD Moonlight Blue",
"brand": "HP",
"current_price": 279.00,
"original_price": 469.00,
"discount_percentage": 40.5,
"processor": "Intel Core i3-N305",
"ram": "8GB",
"storage": "256GB SSD",
"screen_size": "15.6 inch",
"display_type": "Touchscreen",
"operating_system": "Windows",
"color": "Moonlight Blue",
"rating": 4.7,
"review_count": 25,
"features": ["Touchscreen", "Multiple options available"],
"category": "Windows Laptop",
"availability": "In Stock",
"shipping": "Free shipping, arrives today"
},
{
"id": 6,
"name": "HP 14 inch x360 FHD Touch Chromebook Laptop Intel Processor N100 4GB RAM 64GB eMMC Sky Blue",
"brand": "HP",
"current_price": 189.00,
"original_price": 429.99,
"discount_percentage": 56.0,
"processor": "Intel Processor N100",
"ram": "4GB",
"storage": "64GB eMMC",
"screen_size": "14 inch",
"display_type": "FHD Touch",
"operating_system": "Chrome OS",
"color": "Sky Blue",
"rating": 4.5,
"review_count": 2118,
"features": ["2-in-1 Convertible", "Touchscreen", "x360 Design"],
"category": "Chromebook",
"availability": "In Stock",
"shipping": "Free shipping, arrives today"
},
{
"id": 7,
"name": "15.6\" Laptop Intel Celeron N5095, 16GB RAM, 512GB SSD, Windows 11 Pro Work Computer, Fingerprint Reader, Backlit Keyboard, Silver",
"brand": "SANPTENT",
"current_price": 299.99,
"original_price": 1099.00,
"discount_percentage": 72.7,
"processor": "Intel Celeron N5095",
"ram": "16GB",
"storage": "512GB SSD",
"screen_size": "15.6 inch",
"display_type": "Standard",
"operating_system": "Windows 11 Pro",
"color": "Silver",
"rating": 4.2,
"review_count": 10,
"features": ["Fingerprint Reader", "Backlit Keyboard", "Work Computer"],
"category": "Windows Laptop",
"availability": "In Stock",
"shipping": "Free shipping, arrives in 3+ days"
},
{
"id": 8,
"name": "HP 17.3\" Touchscreen Laptop, Intel Core i3, 16GB RAM, 128GB eMMC + 1TB SSD, Windows 11 H, Silver",
"brand": "HP",
"current_price": 549.00,
"original_price": 829.00,
"discount_percentage": 33.8,
"processor": "Intel Core i3",
"ram": "16GB",
"storage": "128GB eMMC + 1TB SSD",
"screen_size": "17.3 inch",
"display_type": "Touchscreen",
"operating_system": "Windows 11 Home",
"color": "Silver",
"rating": 4.6,
"review_count": 121,
"features": ["Large 17.3\" Display", "Touchscreen", "Dual Storage"],
"category": "Windows Laptop",
"availability": "In Stock",
"shipping": "Free shipping, arrives in 2 days"
},
{
"id": 9,
"name": "MSI Thin 15.6 inch FHD 144Hz Gaming Laptop Intel Core i5-13420H NVIDIA GeForce RTX 4050 - 16GB DDR4 512GB SSD Gray (2026)",
"brand": "MSI",
"current_price": 629.00,
"original_price": 699.00,
"discount_percentage": 10.0,
"processor": "Intel Core i5-13420H",
"ram": "16GB DDR4",
"storage": "512GB SSD",
"screen_size": "15.6 inch",
"display_type": "FHD 144Hz",
"operating_system": "Windows",
"color": "Gray",
"rating": 3.9,
"review_count": 9,
"features": ["144Hz Gaming Display", "NVIDIA GeForce RTX 4050", "Gaming Laptop"],
"category": "Gaming Laptop",
"availability": "In Stock",
"shipping": "Free shipping, arrives tomorrow",
"graphics_card": "NVIDIA GeForce RTX 4050"
}
],
"summary": {
"total_laptops_extracted": 9,
"price_range": {
"min_price": 159.00,
"max_price": 619.00
},
"brands": ["HP", "SANPTENT", "ASUS", "Apple", "MSI"],
"categories": ["Windows Laptop", "Chromebook", "MacBook", "Gaming Laptop"],
"operating_systems": ["Windows", "Windows 11 Pro", "Windows 11 Home", "Chrome OS", "macOS"],
"notes": "Ads and promotional content removed. Duplicate entries filtered out. All prices in USD."
}
}
结论
有了合适的工具,爬虫 Walmart 很容易。没有它们,几乎不可能。选择你的方式——传统编码、自动化爬虫,或配备市场上最佳提取工具的 LLM。无论你选择哪种方式,爬虫 Walmart 都比大多数人想象的要容易得多。
在 Bright Data,我们拥有各种各样的工具,适用于传统爬虫、崭新的 AI 团队以及介于两者之间的一切。
注册免费试用,今天就开始吧!