Scraping text from multiple links on a single page...please help!

How to?
#1

I'm trying to extract text of subjective experience reports from erowid.org...I would truly appreciate any help!

I have set the sitemap with a link selector and then a text selector. According to the tutorials I read this should work. However, when I click "scrape" usually nothing happens. However however, maybe once every 50 times it works! I cannot figure out what I am doing differently to make it work but when I try the very same sitemap it will not scrape again. I can't figure out whether the problem is in the site map or elsewhere. Any ideas how to fix the sitemap?

Url:

https://www.erowid.org/experiences/exp.cgi?S1=58&S2=-3&ShowViews=0&Cellar=0&Start=1&Max=284

Sitemap:

{"_id":"meo5","startUrl":["https://www.erowid.org/experiences/exp.cgi?S1=58&S2=-3&ShowViews=0&Cellar=0&Start=1&Max=284"],"selectors":[{"id":"links","type":"SelectorLink","parentSelectors":["_root"],"selector":".exp-list-table a","multiple":true,"delay":0},{"id":"texts","type":"SelectorText","parentSelectors":["links"],"selector":"div.report-text-surround","multiple":false,"regex":"","delay":0}]}

Thank you!

#2

Your first link selector was not correct. For some reason, there was a 1 attached to your selector making it invalid. Instead of selecting '.exp-list-table a', you selected '.exp-list-table1 a' which does not exist, resulting in your sitemap failing.

This should work:

{"_id":"meo5","startUrl":["https://www.erowid.org/experiences/exp.cgi?S1=58&S2=-3&ShowViews=0&Cellar=0&Start=1&Max=284"],"selectors":[{"id":"links","type":"SelectorLink","parentSelectors":["_root"],"selector":".exp-list-table a","multiple":true,"delay":0},{"id":"texts","type":"SelectorText","parentSelectors":["links"],"selector":"div.report-text-surround","multiple":false,"regex":"","delay":0}]}

P.S. I would suggest using more text selectors instead of just one in the next step of your sitemap, as otherwise, the text is not particularly readable.