Sitemap exits immediately after Website State Setup

How to?
#1

Web Scraper version: 1.107.22
Chrome version: 145.0.7632.160
OS: Windows 11

Link to the site you were scraping: lowes.com

Sitemap (Please make the sitemap as minimal as possible so it’s easier to replicate the bug. You can export the sitemap by opening it and choosing “Export Sitemap” in the dropdown menu):

{"_id":"Lowes_debug","startUrl":["https://www.lowes.com/pl/beverage-wine-chillers/kegerators/4294761676"],"selectors":[{"delay":2000,"elementLimit":5000,"id":"scroll","multiple":false,"parentSelectors":["_root"],"selector":"main","type":"SelectorElementScroll"},{"id":"ItemLink","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".prd-brand-description-wrapper a","type":"SelectorLink"}],"websiteStateSetup":{"enabled":true,"performWhenNotFoundSelector":".store-zipcode-wrapper:not(:contains(\"02026\"))","actions":[{"type":"openUrl","url":"https://www.lowes.com/store/"},{"selector":"input[role='searchbox']","type":"click"},{"selector":"input[role='searchbox']","type":"textInput","value":"02026"},{"selector":"button.rightArrowBtn","type":"click"},{"selector":"div[class*=\"StoreInfoWrapper\"]:nth-of-type(1) button span[data-id=\"sc-set-as-my-store\"]","type":"click"}]}}

Pretty printed:

{
  "_id": "Lowes_debug",
  "startUrl": [
    "https://www.lowes.com/pl/beverage-wine-chillers/kegerators/4294761676"
  ],
  "selectors": [
    {
      "delay": 2000,
      "elementLimit": 5000,
      "id": "scroll",
      "multiple": false,
      "parentSelectors": [
        "_root"
      ],
      "selector": "main",
      "type": "SelectorElementScroll"
    },
    {
      "id": "ItemLink",
      "linkType": "linkFromHref",
      "multiple": true,
      "parentSelectors": [
        "_root"
      ],
      "selector": ".prd-brand-description-wrapper a",
      "type": "SelectorLink"
    }
  ],
  "websiteStateSetup": {
    "enabled": true,
    "performWhenNotFoundSelector": ".store-zipcode-wrapper:not(:contains(\"02026\"))",
    "actions": [
      {
        "type": "openUrl",
        "url": "https://www.lowes.com/store/"
      },
      {
        "selector": "input[role='searchbox']",
        "type": "click"
      },
      {
        "selector": "input[role='searchbox']",
        "type": "textInput",
        "value": "02026"
      },
      {
        "selector": "button.rightArrowBtn",
        "type": "click"
      },
      {
        "selector": "div[class*=\"StoreInfoWrapper\"]:nth-of-type(1) button span[data-id=\"sc-set-as-my-store\"]",
        "type": "click"
      }
    ]
  }
}

Running this it will perform the site setup, and then exit after returning to the start URL, yet it works fine without the web site setup steps, returning 24 items.

Log Information (Screen Record):
N/A

Tutorial on how to submit a video bug report: How to submit a video bug report

#2

Hi,

The Website State Setup logic does not look correct. Are you trying to set a store or a delivery location?

#3

Yes, and it seems to work. The issue is with the scrape itself not initiating after setup

#4

Are you trying to set a store or a delivery location?

#5

Either one/doesn't matter. They're actually linked (it sets estimated delivery ZIP after choosing a store), and this is setting store. I set both in my full code, this is just a simplified example. But again, the setup code runs (once one clears cookies before starting)... yet nothing is collected afterward: the scraper immediately exits after returning to start URL.

#6

Any word on what might be causing this?