Pagination Select Just Follows link and won't select

How to?
#1

Hey guys!

Random problem: When I try to select "Next" for a pagination link, it won't select it. It actually follows the link to page 2 and I can't hit Done Selecting. Other links on the page work, just not "Next" or even "1,2,3,4,ect." I tried to cheat the system by making the type a text, selecting it, and then changing the type to link, but this still doesn't do what I want.

Here's a link to the page: http://dallasmarketcenter.com/lines/

In case it helps, I do have to hit Search to view what I want first and going through page 1,2,3, etc doesn't seem to change the URL. I am able to successfully scrape the first page which involves going into various links to get contact information.

Thank you in advance. You guys have been very helpful and this tool is amazing.

Best Regards,
Wes

#2

If the link doesn't change during pagination it is a tel tale sign that you will need to use the Element Click selector.

The issue with you net being able to select the 'Next' button sounds like glitch. Try restarting your Browser and/or the extension.

Here is a sample sitemap that you should be able to build around:

{"_id":"dallas-example","startUrl":["http://dallasmarketcenter.com/lines/"],"selectors":[{"id":"click-element","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"tr.highlight1","multiple":true,"delay":"2000","clickElementSelector":"table.paging:nth-of-type(2) td.next a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"name","type":"SelectorText","parentSelectors":["click-element"],"selector":"td:nth-of-type(1) a","multiple":false,"regex":"","delay":0}]}

#3

Thank you so much for getting back to me! I am still struggling to make it work. I used most of your sitemap. I noticed that you put an extra selector called "name" after the Element Click. What I'm trying to do on each page is go into a series of links. Each time a company link is clicked on, a new window opens. I'm scraping information from each of those pages. So instead of using your "name" selector, I using a link-element-text thing to scrape the info.

When I just do the link (multiple)-element-text think, I can successfully follow all the links on the first page and scrape the information on everything, but when I try to add any rendition of pagination/Element Click, nothing happens.

What can I do to follow and then scrape all of the links, and not just the ones on the first page? Here is my latest sitemap including your Element Click selector:

{"_id":"dallas2","startUrl":["http://dallasmarketcenter.com/lines/"],"selectors":[{"id":"click-element","type":"SelectorElementClick","parentSelectors":["_root","click-element"],"selector":"tr.highlight1","multiple":true,"delay":"2000","clickElementSelector":"table.paging:nth-of-type(2) td.next a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"name link","type":"SelectorLink","parentSelectors":["_root","click-element"],"selector":"td:nth-of-type(1) a","multiple":true,"delay":"2000"},{"id":"element","type":"SelectorElement","parentSelectors":["name link"],"selector":"div.container.col-md-6","multiple":false,"delay":0},{"id":"company","type":"SelectorText","parentSelectors":["element"],"selector":"h2 span","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["element"],"selector":"div.primary-email a","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["element"],"selector":"span.phone-type","multiple":false,"regex":"","delay":0},{"id":"city","type":"SelectorText","parentSelectors":["element"],"selector":"li div div span:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"state","type":"SelectorText","parentSelectors":["element"],"selector":"span:nth-of-type(2)","multiple":false,"regex":"","delay":0}]}

Sorry for all the trouble. I do appreciate the help!

#4

You need to create the Link selector within the Element Click selector and build the sitemap from there out.

Here is start, that will get you to the product page:

{"_id":"dallas2","startUrl":["http://dallasmarketcenter.com/lines/"],"selectors":[{"id":"click-element","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"tr.highlight1","multiple":true,"delay":"2000","clickElementSelector":"table.paging:nth-of-type(2) td.next a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"company-link","type":"SelectorLink","parentSelectors":["click-element"],"selector":"td:nth-of-type(1) a","multiple":false,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["company-link"],"selector":"h2 span","multiple":false,"regex":"","delay":0}]}

#5

This worked! You are the best! Thank you!

#6