Can this site be scraped ? Thanks!

Describe the problem.

Url: https://contrataciondelestado.es/wps/portal/licRecientes

Can this site be scraped ????

Sitemap:
{"_id":"licitacionesultimas","startUrl":["https://contrataciondelestado.es/wps/portal/licRecientes"],"selectors":[{"id":"tabla","type":"SelectorElement","parentSelectors":["_root"],"selector":"table.Width100","multiple":false,"delay":0},{"id":"date","type":"SelectorText","parentSelectors":["tabla"],"selector":"td.trPrimeraFila.tdidFUActualizacionNimWidth span.marginLeft0punto5","multiple":true,"regex":"","delay":0},{"id":"item","type":"SelectorText","parentSelectors":["tabla"],"selector":"tr:nth-of-type(n+4) span.marginLeft0punto5:nth-of-type(1)","multiple":false,"regex":"","delay":0}]}

Yes

You need to set up pagination with a loop using element click
and then use link selector to grab each link
then scrape that page

Here is an example, you need to put in the text selectors on the details page

{"_id":"licitacionesultimas","startUrl":["https://contrataciondelestado.es/wps/portal/licRecientes"],"selectors":[{"id":"tabla","type":"SelectorElementClick","parentSelectors":["root"],"selector":"div#FLYParent","multiple":true,"delay":"4000","clickElementSelector":"input#viewns_Z7_BS88AB1A0GSM10A6E365201G25\:liciRecientes\:siguienteLink.botonEnlace","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueHTML"},{"id":"Link","type":"SelectorLink","parentSelectors":["tabla"],"selector":"a.sinEstilo","multiple":false,"delay":0},{"id":"Set up elements here","type":"SelectorText","parentSelectors":["Link"],"selector":"fieldset#DetalleLicitacionVIS_UOE ul.altoDetalleLicitacion","multiple":true,"regex":"","delay":0}]}

1 Like

Thanks!!!! Great!!!!