Hi,
I am trying to scrape the following site:
https://www.world-airport-codes.com/alphabetical/airport-code/a.html?page=1
This shows all airports that start with letter A.
I want to paginate through each page (1,2,3,4) etc. How do I do this by clicking on the page numbers?
I also want to change the URL so that it go through all URLs with airports that start with letter B,C...Z
E.g. the URL for airports starting with a B is https://www.world-airport-codes.com/alphabetical/airport-code/b.html?page=1
Is this possible?
My current sitemap is:
{"_id":"world-airport-codes-com","startUrl":["https://www.world-airport-codes.com/alphabetical/airport-code/c.html?page=1"],"selectors":[{"id":"pagination","paginationType":"auto","parentSelectors":["_root","pagination"],"selector":"nav:nth-of-type(1) a:nth-of-type(7)","type":"SelectorPagination"},{"id":"elementSelect","multiple":true,"parentSelectors":["pagination"],"selector":"tbody tr","type":"SelectorElement"},{"id":"Airport","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"th","type":"SelectorText"},{"id":"Type","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"td:nth-of-type(1)","type":"SelectorText"},{"id":"City","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"td:nth-of-type(2)","type":"SelectorText"},{"id":"Country","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"td:nth-of-type(3)","type":"SelectorText"},{"id":"IATA","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"td:nth-of-type(4)","type":"SelectorText"},{"id":"ICAO","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"td:nth-of-type(5)","type":"SelectorText"},{"id":"FAA","multiple":false,"parentSelectors":["elementSelect"],"regex":"","selector":"td:nth-of-type(6)","type":"SelectorText"}]}