Newbie, lost. Simple job not so simple

How to?
#1

Trying to use this tool for the first time. I did watch a couple if instruction videos.

Website: Search | MarketingSherpa

What I'm trying to do: Copy the hyperlinks to all the articles on a website. There's about 8600 of them with 10 to a page.

  • Test1: If I create a selector to grab all 10 links on page 1, it works.
  • Test2: If I create a selector to go through all the pages, it works.
  • Test3: If I try to combine them, it fails to grab any data (I think).
    I do know the graph doesn't look right (it shows just the 2 selectors and doesn't allow me to drill further down).

When I say start scrape, it's going through the pages, but I still see "No data scraped yet." even if I refresh. I'm not sure if I have to wait for the scrape to finish before checking any results. If I stop it at 10%, I get no data.

Is there a way to limit this to the first 5 pages as a test. When I did Test 3, it took 1/2 hour to do 10% of the pages. I stopped it here because I didn't want to wait 5 hours for a test.

If I get this working, I may add following the link to grab certain data. But I already have hand written code to do that

I hope this makes sense and someone can help. Thanks.

#2

@TomCollins317
This is the most basic way I guess:

{"_id":"marketingsherpa-com","startUrl":["https://www.marketingsherpa.com/library"],"selectors":[{"id":"product-link","type":"SelectorLink","parentSelectors":["element-click"],"selector":"h3 a","multiple":false,"delay":0},{"id":"element-click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.g_res_row","multiple":true,"delay":"800","clickElementSelector":"div.searchNav a:contains(\"1\"), div.searchNav a:contains(\"2\"), div.searchNav a:contains(\"3\"), div.searchNav a:contains(\"4\"), div.searchNav a:contains(\"5\") ","clickType":"clickOnce","discardInitialElements":"discard","clickElementUniquenessType":"uniqueCSSSelector"}]}

#3

Thank you. Your answer helped a lot.

1 Like