Table with pagination

[AlexShevyakov]

Describe the problem.
Hi,
I have been trying to create a scrapper for what seems to be a relatively simple site layout - a table and pagination.
So the logic is:

1. Scrap the table;
2. Click pagination button;
3. Scrap the table

This is dynamically refreshed table and I watched relevant video where the similar guidance was provided, however, with no success.
The pages are get flipped ok but the table data remains uncaught.
Apprecaite a hint on this.

Here is what my current JSON looks like

{
"_id":"psc",
"startUrl":[
"https://www.website"
],
"selectors":[
{
"id":"pagination-click",
"type":"SelectorElementClick",
"parentSelectors":[
"_root"
],
"selector":"table",
"multiple":true,
"delay":"1000",
"clickElementSelector":".pagination a",
"clickType":"clickOnce",
"discardInitialElements":"discard-when-click-element-exists",
"clickElementUniquenessType":"uniqueText"
},
{
"id":"data",
"type":"SelectorTable",
"parentSelectors":[
"pagination-click"
],
"selector":"table",
"multiple":true,
"columns":[
{
"header":"Date",
"name":"Date",
"extract":true
},
{
"header":"Vessel Name",
"name":"Vessel Name",
"extract":true
},
{
"header":"Vessel Name at Inspection",
"name":"Vessel Name at Inspection",
"extract":true
},
{
"header":"Inspection Type",
"name":"Inspection Type",
"extract":true
},
{
"header":"Authority",
"name":"Authority",
"extract":true
},
{
"header":"Port",
"name":"Port",
"extract":true
},
{
"header":"# Deficiencies",
"name":"Deficiencies",
"extract":true
},
{
"header":"Vessel was Detained",
"name":"Vessel was Detained",
"extract":true
},
{
"header":"Status",
"name":"Status",
"extract":true
}
],
"delay":0,
"tableDataRowSelector":"tbody tr",
"tableHeaderRowSelector":"thead tr"
}
]
}

[leemeng]

See link below for these type of tables.

Table question - scraping select fields and recreating table in excel

You've probably set all your text scrapers to "multiple", so this would not produce the results you want. You'll need to create a selector for the table rows instead, and place the text scrapers under the rows selector. The rows selector acts as a "container" for your text scrapers so they will be grouped together. The rows selector is the one that needs to be set to "multiple", while the text scrapers are not (unchecked). Take a look at this example below where I scrape a table from the w3scho…

[AlexShevyakov]

@leemeng
Ok, where does the pagination go?
Looking at the tutorial with similar pagination links, I first set element-click to click the page button at the bottom {"type":"SelectorElementClick",}
Question 1 - what would be the SELECTOR here? I used table as wrapping element.

Inside that pagination-click I run {"type":"SelectorTable",} which is multiple.

In your example you scrape only a single table which I have no problem with. It is the table AND pagination together.

[Matthew_Riot]

Did you ever figure this out? I'm having the same issue. I can scrape the table fine but can't get it to play with the pagination.