Pagination with element click does not work

How to?
#1

Pagination is not running and I have no idea why. Only the first entry is extracted. Any help welcome. Thank you in advance for your help!

{"_id":"pagination_problem","startUrl":["https://www.sothebys.com/en/buy/auction/2019/contemporary-photographs/hiroshi-sugimoto-simi-valley-drive-in-simi-valley"],"selectors":[{"id":"pagearea","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.row","multiple":false,"delay":"2000","clickElementSelector":"a.css-1tgvpkp","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"lnumber","type":"SelectorText","parentSelectors":["pagearea"],"selector":"span.css-we5xhf","multiple":false,"regex":"","delay":0},{"id":"lprice","type":"SelectorText","parentSelectors":["pagearea"],"selector":".css-10pbwcw p","multiple":false,"regex":"","delay":0}]}

#2

Not an excellent solution, but this should do the trick:

{"_id":"pagination_problem","startUrl":["https://www.sothebys.com/en/buy/auction/2019/contemporary-photographs/hiroshi-sugimoto-simi-valley-drive-in-simi-valley"],"selectors":[{"id":"pagearea","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.row","multiple":true,"delay":"2000","clickElementSelector":"div> div > div > div > div > div > div:has(h1) div:contains(\"PLACE BID\") a:has(img[src=\"data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSIyMCIgaGVpZ2h0PSIyMSIgdmlld0JveD0iMCAwIDIwIDIxIj4KICAgIDxwYXRoIGZpbGw9IiMxMzBDMEUiIGZpbGwtcnVsZT0iZXZlbm9kZCIgZD0iTTAgMTAuMzN2LS40ODZoMTguMzVMOS42MzIuODVBLjUwMy41MDMgMCAwIDEgOS42NC4xNDNhLjQ5Mi40OTIgMCAwIDEgLjcuMDA3bDkuNTE4IDkuODIyYy4xODcuMTkyLjE5LjQ5OS4wMDUuNjk1bC05LjYwNyAxMC4xNzhhLjQ5LjQ5IDAgMCAxLS43LjAxNy41MDQuNTA0IDAgMCAxLS4wMTYtLjcwN2w4Ljc4OC05LjMxMUgwdi0uNDg2YS41MTMuNTEzIDAgMCAxIDAtLjAyOXoiLz4KPC9zdmc+Cg==\"])","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"lnumber","type":"SelectorText","parentSelectors":["pagearea"],"selector":"span.css-we5xhf","multiple":false,"regex":"","delay":0},{"id":"lprice","type":"SelectorText","parentSelectors":["pagearea"],"selector":".css-10pbwcw p","multiple":false,"regex":"","delay":0}]}

#3

First thank you very much for your help. The pagination is now working but when scrapping: no data are extracted... I have 2 text elements - lot number (lnumber) and price estimation lprice). Do you have an idea for this, too? Thanks in advance

#4

With the Element Click selector, the data will only be available when the selector has finished executing. During this process the data will not be available in the data panel.

If you want to test whether the selector will return the correct result, toggle the "Click Type" to "Click Once" and run the scraping job. This will shorten the execution of the "Click Selector" to a single click and return sample results immediately.

#5

Thank you. Now it works.