How can scrape from dropdown menu

How to?
#1

I need to scrape all issue link from drop downmenu

Url: Analyst  Home-The home of premier fundamental discoveries, inventions and applications in the analytical and bioanalytical sciences<br/><br/>Editor-in-chief: Melanie Bailey<br/>Impact factor: 3.6<br/>Time to first decision (peer reviewed only): 27 days

Sitemap:
{"_id":"RSC_LINK_SCRAPE","startUrl":["https://pubs.rsc.org/en/journals/journalissues/an#!recentarticles&adv"],"selectors":[{"clickActionType":"real","clickElementSelector":".list--expandable ul","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":0,"discardInitialElements":"discard-when-click-element-exists","id":"CLICK","multiple":true,"parentSelectors":["_root"],"selector":"div.list--expandable","type":"SelectorElementClick"},{"id":"LINKS","linkType":"linkFromHref","multiple":true,"parentSelectors":["CLICK"],"selector":"a.list__item-link","type":"SelectorLink"}]}

image
image1365×739 162 KB

#2

Hi, this should do the trick:

{"_id":"RSC_LINK_SCRAPE","startUrl":["https://pubs.rsc.org/en/journals/journalissues/an#!recentarticles&adv"],"selectors":[{"clickActionType":"real","clickElementSelector":"select#JournalIssueFinder option","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":0,"discardInitialElements":"discard-when-click-element-exists","id":"CLICK","multiple":true,"parentSelectors":["_root"],"selector":"div.list--expandable","type":"SelectorElementClick"},{"id":"LINKS","linkType":"linkFromHref","multiple":true,"parentSelectors":["CLICK"],"selector":"a.list__item-link","type":"SelectorLink"}]}

The 'Click selector' value has to match the dropdown items.

1 Like
#3

Wow it works perfect for me . Thank you so much

1 Like