I could only find solution when next button gives result like page 1-> page 2 or page 2-> page 3.
But website below has next page that goes to 11.
I could only scrape data of 1-11 pages.
please help me
Url:
학술발표회 - 초록 검색 및 수정 - 대한화학회
or
new.kcsnet.or.kr/?mid=abstract_search&page=1&qpage=&spage=&main_number=128
Sitemap:
{"_id":"kcs","startUrl":["학술발표회 - 초록 검색 및 수정 - 대한화학회 a","type":"SelectorLink"},{"delay":0,"id":"titlelink","multiple":true,"parentSelectors":["page"],"selector":"a.text-left","type":"SelectorLink"},{"delay":0,"id":"abstract","multiple":false,"parentSelectors":["titlelink"],"regex":"","selector":"div.read_body","type":"SelectorText"}]}