Pagination breadth first navigation on the graph

How to?
#1

Hi,
I am trying to paginate through a site, and tried both Element Click and Pagination.
The graph is:
_root > pagination
> pagination
> …
> …
> extractor
> extractor

When I execute the scrape, it first navigates through all pages, keeps the links and then goes into each page to extract. Unfortunately, some of the links are expired by the time they get reached.

Is there a way to visit a page, then extract, then visit the next page, extract and so on? Basically I want to breadth first traverse the tree.

Note: you need to first login as guest and pass through a captcha to run the scraping.

Sitemap:

{"_id":"DDD","startUrl":["https://deltio.tnomik.gr/auctions"],"selectors":[{"id":"Details","parentSelectors":["_root","next"],"type":"SelectorLink","selector":"a.button","multiple":true,"linkType":"linkFromHref"},{"id":"auctionDate","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='dateTextField']","multiple":false,"extractAttribute":"value"},{"id":"debtorName","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='debtor_name']","multiple":false,"extractAttribute":"value"},{"id":"auctioneer","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='auctioneer']","multiple":false,"extractAttribute":"value"},{"id":"auctionId","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='guid']","multiple":false,"extractAttribute":"value"},{"id":"currentStatus","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='currentStatusField']","multiple":false,"extractAttribute":"value"},{"id":"vat","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='vat_number']","multiple":false,"extractAttribute":"value"},{"id":"vatAuctioneer","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='vat_auctioneer']","multiple":false,"extractAttribute":"value"},{"id":"offerPrice","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='offer_price']","multiple":false,"extractAttribute":"value"},{"id":"publishedDate","parentSelectors":["Details"],"type":"SelectorElementAttribute","selector":"input[name='publishedDateField']","multiple":false,"extractAttribute":"value"},{"id":"next","parentSelectors":["Details"],"type":"SelectorElementClick","clickActionType":"real","clickElementSelector":"button[name='nextPage']","clickElementUniquenessType":"uniqueText","clickType":"clickMore","delay":2000,"discardInitialElements":"do-not-discard","multiple":true,"selector":".wrapper div.wrapper"}]}

#2

Hello,

Given the fact, that the pagination happens on the same URL, it will not be possible to handle each page separately.