Hello guys, I need help to do the following thing, I want to scrape everything on this link https://10times.com/tradeshows, what I want exactly is name(easy) & contact info (not easy for me), to get the contacts info you need to first log in & then click on contacts, check this link for exampe
https://10times.com/all-china-leather
All help will be very appreaciated.
Hi!
You have to create an Element Click selector, pick 'Contacts' button for Click selector, and pop-up window to Selector itself.
Then you create text selector inside Click Selector, and pick needed text fields into it.
It worked !!! you're a saviour man thank you very much !!!!!!!
One last question though, the website I'm scraping has that "Load more" buttton, and in order to get to the bottom you must click on it 5 times, so I added a scroll down selector and tested, it only clicked on "load more" once, and then I put 100/2000/3000 ms in the "delay" associated with the scroll selector and it actually clicked on "load more" twice, how do I get it to click on it 5 times instead of just 2 ?
My sitemap:
{"_id":"trade","startUrl":["https://10times.com/tradeshows"],"selectors":[{"id":"parent","type":"SelectorLink","parentSelectors":["_root"],"selector":"h2 a","multiple":true,"delay":0},{"id":"element click","type":"SelectorElementClick","parentSelectors":["parent"],"selector":"div.modal-body","multiple":false,"delay":0,"clickElementSelector":"a.btn.x-ob-cd","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"txt","type":"SelectorText","parentSelectors":["element click"],"selector":"parent","multiple":false,"regex":"","delay":0},{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.aligncenter a.btn","multiple":false,"delay":""}]}
You can use :nth-last-of-type(n) or :nth-last-child(n) CSS selector for it to scroll all through, so it will catch the very last element until it loads more and changes it to the next very last element.
Replace your Element Scroll selector to:
tr.box:nth-last-of-type(n)
or
tr.box:nth-last-child(n)
Both should do the trick. Don't forget to tick Multiple into it.
UPD: mistype
I thought "N" had to be replaced by a numeric value. You can actually just use n?
learned something new. Learning CSS through scraping
