Describe the problem.
I am trying to capture the data from a table . it does have pagination. suppose if the table has 4 pagination links. it captures only last two (3 and 4) . it is not capturing data (table) from 1 and 2 pages
Url: https://www.diamondexchange.com.au/choose-a-diamond ( it has 900K records). Pls apply following "advance filter"
POLISH - very good
SYMMETRY - good
FLUORESCENCE - medium. before start scraping it
Sitemap:
{"_id":"diamondexchange_new","startUrl":["https://www.diamondexchange.com.au/choose-a-diamond"],"selectors":[{"id":"table","type":"SelectorTable","selector":"div.tab-pane div div.diamond-control-tbl > table","parentSelectors":["_root","pagination"],"multiple":true,"columns":[{"header":"Shape","name":"Shape","extract":true},{"header":"Carat","name":"Carat","extract":true},{"header":"Colour","name":"Colour","extract":true},{"header":"Clarity","name":"Clarity","extract":true},{"header":"Cut","name":"Cut","extract":true},{"header":"Price (Incl. GST)","name":"Price","extract":true},{"header":"CM","name":"CM","extract":true},{"header":"IOF","name":"IOF","extract":true},{"header":"H&A","name":"H&A","extract":true},{"header":"Shortlist","name":"Shortlist","extract":false}],"delay":0,"tableDataRowSelector":"tr.table-bg > td > table > tbody > tr:nth-of-type(1)","tableHeaderRowSelector":"thead tr"},{"id":"pagination","type":"SelectorElementClick","selector":"li.ng-scope a.ng-binding","parentSelectors":["_root"],"multiple":true,"delay":"5000","clickElementSelector":"li.ng-scope a.ng-binding","clickType":"clickOnce","discardInitialElements":true,"clickElementUniquenessType":"uniqueText"}]}
could you pls help me to solve this problem. I really appreciate your response
Thanks!