Pagination Problem

How to?
#1

I can't figure out how to get this sitemap to work with the pagination on this site. Any help would be very appreciated!

Sitemap:

{"_id":"mnbar","startUrl":["http://www.mnbar.org/member-directory/lawyer-search-results?Seed=63&City=minneapolis&State=MN&Distance=50&LicenseStateID=41"],"selectors":[{"id":"name","type":"SelectorLink","selector":"tr.GridItemStyle:nth-of-type(n+2) a","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"email","type":"SelectorLink","selector":"a#Header_C001_lnkEmailAttorney.button","parentSelectors":["name"],"multiple":false,"delay":0},{"id":"page","type":"SelectorLink","selector":"td td:nth-of-type(n+2) a","parentSelectors":["_root","page"],"multiple":true,"delay":0}]}

#2

You have to set "name" selector as child selector for "page" selector as well.

#3

I set "name" as child selector for "page" but it still only scrapes the first page. I can only ever get it to scrape the first page. Any other suggestions. Thanks for the help!

#4

I just took a closer look at the site and found out that pagination has javascript. It won't be possible to scrape this site with current web scraper selectors because the page reloads each time when page changes but the URL doesn't change.

#5

Hi there,
I've faced a problem with pagination of the pages on website I'm trying to scrape.
Could you please help with this sitemap in order to works fine and to go to the next page.

Thanks

{"_id":"markita","startUrl":["https://markita.net/search?keys=&tidcat=All&tid=All&sell_price_from=&sell_price_to="],"selectors":[{"id":"Products","type":"SelectorLink","selector":"div.view.view-display-id-page_1 div.vertical-middle-2 a","parentSelectors":["_root"],"multiple":true,"delay":"0"},{"id":"Items","type":"SelectorElement","selector":"div#content-area-inner","parentSelectors":["Products"],"multiple":true,"delay":"1000"},{"id":"Name","type":"SelectorText","selector":"p:nth-of-type(1) strong","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"Price","type":"SelectorText","selector":"div.product-info span.uc-price-product","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"Descri","type":"SelectorText","selector":"div.product-body","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"SKU","type":"SelectorText","selector":"div.product-info.model","parentSelectors":["Items"],"multiple":false,"regex":"","delay":0},{"id":"Weight","type":"SelectorText","selector":"div.product-info.weight","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"Producer","type":"SelectorText","selector":"div.fields-additional-info a","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"img","type":"SelectorImage","selector":"a.colorbox img.imagecache","parentSelectors":["Items"],"multiple":true,"delay":0},{"id":"Pages","type":"SelectorLink","selector":"li.pager-next a.active","parentSelectors":["Products"],"multiple":true,"delay":"2000"}]}