Hello community!
I'm a newbie and I'm having a hard time scraping this URL: http://www.aquarismototal.com/categoria/535167/Racoes.
I need to extract all the products from this page. There is a "more button" ("VER MAIS RESULTADOS") at the end of the page that needs to be clicked in order to show all products. I need also to open each product's page so I can scrape additional data from the products.
I've created the sitemap below an it did scrape all 183 products on the page through clicking the "more" button. The results downloaded in the CSV file, however, are a mess. I haven't been able to figure out what I did wrong.
{"_id":"aquarismototal","startUrl":["http://www.aquarismototal.com/categoria/535167/Racoes"],"selectors":[{"id":"pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.boxItemListagem.aplicaEfeitoListagem a.linkListagemProduto","multiple":true,"delay":"6000","clickElementSelector":"div.botaoVerMaisRetornaAjax p","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"nome","type":"SelectorText","parentSelectors":["produto"],"selector":"div.boxInformacoesDetalhesProduto h1","multiple":false,"regex":"","delay":0},{"id":"marca","type":"SelectorText","parentSelectors":["produto"],"selector":"div.boxInformacoesDetalhesProduto div.boxMarcaModeloDescricaoProduto p:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"produto","type":"SelectorLink","parentSelectors":["pagination"],"selector":"parent","multiple":true,"delay":0},{"id":"preco","type":"SelectorText","parentSelectors":["produto"],"selector":"span#vr_preco_principal_produto","multiple":false,"regex":"","delay":0},{"id":"imagem","type":"SelectorImage","parentSelectors":["produto"],"selector":"img.link-lightbox2","multiple":false,"delay":0}]}
I would be really thankful if someone could help me with that!