Scrapping Data from Dynamic table

How to?
#1

I'm trying to scrape data from the table in below link for the past three days and i was not successful:

My selectors for the table were:
Selector: .main-content .pop-grid
Header row selector: tr.header-row
Data rows selector: tr.ms:nth-of-type(n+1)

Set to Multiple

Untitled
Untitled1920×805 72.5 KB

The table is dynamic and it changes the outcome based on changing the filters, I have unticked all the filter boxes to make as much elements available as possible, the extracted data is only showing the header details but no data shown on the rows.

I'm new in using the Web scraper Chrome extension, it is helping with other tables but not this one, could you suggest best solution to crape these data using the Web Scraper?

Sitemap:
{"_id":"NGC-Early-Dimes","startUrl":["https://www.ngccoin.com/census/united-states/dimes/28/"],"selectors":[{"columns":[{"extract":true,"header":"Year/Mint\n\t\t\t\t\t\t\n\t\t\t\t\t\t\tCoin","name":"Coin"},{"extract":true,"header":"Denom","name":"Denom"},{"extract":true,"header":"Desig","name":"Desig"},{"extract":true,"header":"Total","name":"Total"},{"extract":true,"header":"PrAg","name":"PrAg"},{"extract":true,"header":"PrAg","name":"PrAg"},{"extract":true,"header":"G","name":"00G"},{"extract":true,"header":"G","name":"00G"},{"extract":true,"header":"VG","name":"0VG"},{"extract":true,"header":"VG","name":"0VG"},{"extract":true,"header":"F","name":"00F"},{"extract":true,"header":"F","name":"000F"},{"extract":true,"header":"VF","name":"0VF"},{"extract":true,"header":"VF","name":"0VF"},{"extract":true,"header":"40","name":"040"},{"extract":true,"header":"40","name":"040"},{"extract":true,"header":"45","name":"045"},{"extract":true,"header":"45","name":"045"},{"extract":true,"header":"45","name":"045"},{"extract":true,"header":"45","name":"045"},{"extract":true,"header":"50","name":"050"},{"extract":true,"header":"50","name":"050"},{"extract":true,"header":"50","name":"050"},{"extract":true,"header":"50","name":"050"},{"extract":true,"header":"53","name":"053"},{"extract":true,"header":"53","name":"053"},{"extract":true,"header":"53","name":"053"},{"extract":true,"header":"53","name":"053"},{"extract":true,"header":"55","name":"055"},{"extract":true,"header":"55","name":"055"},{"extract":true,"header":"55","name":"055"},{"extract":true,"header":"55","name":"055"},{"extract":true,"header":"58","name":"058"},{"extract":true,"header":"58","name":"058"},{"extract":true,"header":"58","name":"058"},{"extract":true,"header":"58","name":"058"},{"extract":true,"header":"60","name":"060"},{"extract":true,"header":"60","name":"060"},{"extract":true,"header":"60","name":"060"},{"extract":true,"header":"60","name":"060"},{"extract":true,"header":"61","name":"061"},{"extract":true,"header":"61","name":"061"},{"extract":true,"header":"61","name":"061"},{"extract":true,"header":"61","name":"061"},{"extract":true,"header":"62","name":"062"},{"extract":true,"header":"62","name":"062"},{"extract":true,"header":"62","name":"062"},{"extract":true,"header":"62","name":"062"},{"extract":true,"header":"63","name":"063"},{"extract":true,"header":"63","name":"063"},{"extract":true,"header":"63","name":"063"},{"extract":true,"header":"63","name":"063"},{"extract":true,"header":"64","name":"064"},{"extract":true,"header":"64","name":"064"},{"extract":true,"header":"64","name":"064"},{"extract":true,"header":"64","name":"064"},{"extract":true,"header":"65","name":"065"},{"extract":true,"header":"65","name":"065"},{"extract":true,"header":"65","name":"065"},{"extract":true,"header":"65","name":"065"},{"extract":true,"header":"66","name":"066"},{"extract":true,"header":"66","name":"066"},{"extract":true,"header":"66","name":"066"},{"extract":true,"header":"66","name":"066"},{"extract":true,"header":"67","name":"067"},{"extract":true,"header":"67","name":"067"},{"extract":true,"header":"67","name":"067"},{"extract":true,"header":"67","name":"067"},{"extract":true,"header":"68","name":"068"},{"extract":true,"header":"68","name":"068"},{"extract":true,"header":"68","name":"068"},{"extract":true,"header":"68","name":"068"},{"extract":true,"header":"69","name":"069"},{"extract":true,"header":"69","name":"069"},{"extract":true,"header":"70","name":"070"},{"extract":true,"header":"70","name":"070"}],"id":"Census","multiple":true,"parentSelectors":["_root"],"selector":".main-content .pop-grid","tableDataRowSelector":"tr:nth-of-type(n+2)","tableHeaderRowSelector":"tr.header-row","type":"SelectorTable"}]}

#2

Hi,

The table selector is designed for a very basic table setup, which is not the case here. there are two tables next to each other.

In this case, it will be required to create each header item as a separate selector. See below a reference sitemap to get you started:

{"_id":"NGC-Early-Dimes","startUrl":["https://www.ngccoin.com/census/united-states/dimes/28/"],"selectors":[{"id":"row-table-1","multiple":true,"parentSelectors":["_root"],"selector":"div.pinned tr.ms:not(.hide)","type":"SelectorElement"},{"id":"Year-Mint","multiple":false,"parentSelectors":["row-table-1"],"regex":"","selector":"span.standard","type":"SelectorText"},{"id":"Denom","multiple":false,"parentSelectors":["row-table-1"],"regex":"","selector":"td:nth-of-type(2)","type":"SelectorText"},{"id":"Desig","multiple":false,"parentSelectors":["row-table-1"],"regex":"","selector":"td:nth-of-type(3)","type":"SelectorText"},{"id":"Total","multiple":false,"parentSelectors":["row-table-1"],"regex":"","selector":"td.census-only","type":"SelectorText"},{"extractAttribute":"href","id":"ebay","multiple":false,"parentSelectors":["row-table-1"],"selector":"a.ebay-btn","type":"SelectorElementAttribute"},{"id":"row-table-2","multiple":true,"parentSelectors":["_root"],"selector":"div:not(.pinned) > table tr.ms:not(.hide)","type":"SelectorElement"},{"id":"PrAg","multiple":false,"parentSelectors":["row-table-2"],"regex":"","selector":"td.base.grade-PrAg","type":"SelectorText"},{"id":"grade-G","multiple":false,"parentSelectors":["row-table-2"],"regex":"","selector":"td.base.grade-G","type":"SelectorText"},{"id":"grade-VG","multiple":false,"parentSelectors":["row-table-2"],"regex":"","selector":"td.base.grade-VG","type":"SelectorText"}]}
1 Like
#3

Hi JanAp,

Thanks for your response, i never thought about it this way, it actually worked.
Cheers

1 Like
#4

Glad I could help! If you have a moment, I'd appreciate you leaving a review on the Web Scraper extension page! Your feedback helps us improve!

Thanks, and have a great day!