https://www.zaubacorp.com/companysearchresults/NOIDA

How to?
#1

I am unable to extract the complete data from the website due to a pagination issue.
The target URL is:

{"_id":"ZAUBA2","startUrl":["https://www.zaubacorp.com/company-by-address/NOIDA"],"selectors":[{"id":"NEXT PAGE","parentSelectors":["_root","NEXT PAGE"],"paginationType":"auto","type":"SelectorPagination","selector":"div:nth-of-type(3) div.dt-layout-end"},{"id":"SITEMAPLINKS","parentSelectors":["_root"],"type":"SelectorLink","selector":"td:nth-of-type(2) a","multiple":true,"version":2,"linkType":"linkFromHref"},{"id":"COMPANY NAME","parentSelectors":["SITEMAPLINKS"],"type":"SelectorText","selector":"#title strong","multiple":false,"regex":"","multipleType":"singleColumn","version":2},{"id":"DIRECTOR LINK","parentSelectors":["SITEMAPLINKS"],"type":"SelectorLink","selector":"li:nth-of-type(2) a","multiple":false,"version":2,"linkType":"linkFromHref"},{"id":"CONTACT INFORMATION","parentSelectors":["SITEMAPLINKS"],"type":"SelectorLink","selector":"li:nth-of-type(3) a","multiple":false,"version":2,"linkType":"linkFromHref"},{"id":"DIRECTOR NAME","parentSelectors":["DIRECTOR LINK"],"type":"SelectorText","selector":"div.table-responsive:nth-of-type(1) .table-condensed tr:nth-of-type(1) td:nth-of-type(2)","multiple":false,"regex":"","multipleType":"singleColumn","version":2},{"id":"EMAILID","parentSelectors":["CONTACT INFORMATION"],"type":"SelectorText","selector":".col-md-6 span:nth-of-type(1)","multiple":false,"regex":"","multipleType":"singleColumn","version":2},{"id":"WEBSITE","parentSelectors":["CONTACT INFORMATION"],"type":"SelectorText","selector":".col-md-6 span:nth-of-type(2)","multiple":false,"regex":"","multipleType":"singleColumn","version":2},{"id":"ADDRESS","parentSelectors":["CONTACT INFORMATION"],"type":"SelectorText","selector":"span:nth-of-type(4)","multiple":false,"regex":"","multipleType":"singleColumn","version":2}]}

The website loads additional results across multiple pages, but the pagination is either dynamically loaded, hidden behind JavaScript, or not easily accessible to my scraper. As a result, my extraction script only retrieves data from the first page and does not navigate to subsequent pages. I need a solution that allows me to detect, access, and iterate through all paginated pages to extract the full dataset.

#2

Better you scrape this site in two stages, where in stage 1, you get all the CIN Urls from the main page, then in stage 2 you have a different sitemap which uses all those Urls as Starturls. You can also paste links into a site like pastelink and scrape that page instead.
This page expires in 3 months:

This is the stage 1 sitemap which gets the CIN Urls:

{"_id":"zaubacorp-noida-stage-1","startUrl":["https://www.zaubacorp.com/companysearchresults/NOIDA"],"selectors":[{"id":"row_elements","parentSelectors":["_root","paginator"],"type":"SelectorElement","selector":"table#results > tbody > tr","multiple":true,"scroll":true,"elementLimit":100},{"id":"CIN_page_link","parentSelectors":["row_elements"],"type":"SelectorLink","selector":"td:nth-of-type(1) a","multiple":false,"version":2,"linkType":"linkFromHref"},{"id":"Name","parentSelectors":["row_elements"],"type":"SelectorText","selector":"td:nth-of-type(2)","multiple":false,"regex":"","multipleType":"singleColumn","version":2},{"id":"paginator","parentSelectors":["_root"],"type":"SelectorElementClick","clickActionType":"real","clickElementSelector":"ul a[aria-label='Next']","clickElementUniquenessType":"uniqueText","clickType":"clickMore","delay":2500,"discardInitialElements":"discard-when-click-element-exists","multiple":true,"selector":"div.basic-cont"}]}