Scraping from a pop up

How to?
#1

Hi, All,

I'm collecting article citations and references for a bibliographic network analysis.

I'm interested in scraping from inside a popup window, closing the window, then moving forward in the collection. Unfortunately, I'm having trouble setting up the selectors so that it collects from the window and then moves forward. Instead it freezes up.

Here's the language:

Cite this Item

Here's the journal home page: https://www.jstor.org/journal/arteducation

Here's a link to the article citation: https://www.jstor.org/stable/41480624?seq=1#page_scan_tab_contents

Any help would be much appreciated!

#2

Here is an example sitemap that clicks on the "cite this item" button to load the popup and then extracts data from the popup. Basically it is an element click selector that clicks on the button and then selects the wrapper element of the popup contents.

{"_id":"jstor","startUrl":["https://www.jstor.org/stable/41480624?seq=1#page_scan_tab_contents"],"selectors":[{"id":"click-cite-item","type":"SelectorElementClick","selector":"div#citation-tools.reveal-modal","parentSelectors":["_root"],"multiple":false,"delay":"2000","clickElementSelector":"a.cite-this-item","clickType":"clickOnce","discardInitialElements":true,"clickElementUniquenessType":"uniqueText"},{"id":"mla","type":"SelectorText","selector":"div.mla","parentSelectors":["click-cite-item"],"multiple":false,"regex":"","delay":0},{"id":"apa","type":"SelectorText","selector":"div.apa","parentSelectors":["click-cite-item"],"multiple":false,"regex":"","delay":0}]}
1 Like
#3

Thank you, looking forward to trying it some more. My first attempt at following your suggestions opened up the popups beautifully and did not get stuck. However, my text of the citation is not being collected as data. I will continue to play with it and hopefully succeed... if not, I'll post again-