I have a page with a list of links. I need to go into all the links and scrape data from them on static pages. I set it up as told in tutorials, with the "Link" type on the links to click on the parent page.
I tried all 4 link types but none work. The links are not clicked and I don't get into the pages to scrape.
What is wrong? This is the page: Browse Companies | RPGGeek
@3HAT0K This is the sitemap export..
{"_id":"RPGG","startUrl":["Browse Companies | RPGGeek [title='next page'] b","type":"SelectorPagination"},{"id":"Company_link_to_moreinfo","parentSelectors":["Next_pagination"],"type":"SelectorLink","selector":".forum_table a","multiple":true,"linkType":"linkFromHref"},{"id":"Company_name","parentSelectors":["Company_link_to_moreinfo"],"type":"SelectorText","selector":"div.geekitem_name","multiple":false,"regex":""},{"id":"Company_website_link","parentSelectors":["Company_link_to_moreinfo"],"type":"SelectorLink","selector":"#edit_rep_weblinkid a","multiple":false,"linkType":"linkFromHref"},{"id":"Company_description","parentSelectors":["Company_link_to_moreinfo"],"type":"SelectorText","selector":"#module_3 td","multiple":false,"regex":""},{"id":"Company_weblinks","parentSelectors":["Company_link_to_moreinfo"],"type":"SelectorLink","selector":"div.ng-scope .ng-scope .moduleRow a[ng-href]","multiple":false,"linkType":"linkFromHref"}]}
I can't get it to work. It clicks through the pagination Next button but never click on the links on the page to scrape from those pages.
