Element Click Pagination with links on each page to be scrapped

Hi there!

Just trying to pull some race-data down from http://www.racetecresults.com and having a little trouble.

Basically I would like the scrapper to run down the list of names, open the link, then pull the split times for each record, which is simple enough - however I seem to run into issue when I would like to move on the next page to pick up the next set of 50 records.

Because the page dynamically loads data from the sever I require the "Element Click" function to get the scraper to navigate to the next page, however within an element click I cannot seem to then follow the link to open the split time data page.

Any help or suggestions would be greatly appreciated.

Cheers!

Gram

Site: http://www.racetecresults.com/results.aspx?CId=16387&RId=6125&EId=2

Hi!

Have you noticed that records can be directly downloaded as XLS / CSV / PDF?
Or you need to scrape some data that is not shown?

Hi Iconoclast,

Yep - have noticed that you can export to xls, however it only dumps out the total time, not the individual splits which is what I am actually after.

Thanks for the heads up though!

Grams

Grams,

I'll try to help you tomorrow, unless you've already managed how to do it.

Thanks Iconoclast - that would be much appreciated - still struggling over here haha

Grams

Hi Grams, unfortunately website won't allow me enter and returns info about tech problems they're currently experiencing. Hopefully it will be fixed soon so I could finish.

@Grams,

website finally works good - i've managed to complete the pagination, it's a bit tricky as you have to properly select a wrapper for Element Click selector, otherwise it will infinitely go from page 1 to page 2 and vice versa. I've also applied a limitation to selected pages, as it has further empty pages that can be clicked but will result in an error and you won't get any results. Please keep in mind that you will have to adjust the page limit for each table you will scrape.

This sitemap will let you go from page 1 to page 7 (applied limit), and go to each name linked in table, please add text/table selectors inside the link (text selector must have link selector as parent):

{"_id":"racetecresults","startUrl":["http://www.racetecresults.com/results.aspx?CId=16387&RId=6125&EId=2"],"selectors":[{"id":"click","type":"SelectorElementClick","selector":"table#ctl00_Content_Main_GridTable","parentSelectors":["_root"],"multiple":true,"delay":"2000","clickElementSelector":"div#ctl00_Content_Main_divTopPager td td:nth-of-type(-n+7) a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"link2name","type":"SelectorLink","selector":"td.dxgv:nth-of-type(4) a.dxeHyperlink","parentSelectors":["click"],"multiple":true,"delay":"2000"}]}