How to scrape in mobile view?

Hi people,

a lot of times there is no pagination on websites and easier to scrape with only a scroll down command all the data.. how can we manage de widht of the page of scraping ? thx

exemple

Thanks a lot :slight_smile:

I'm a little confused by your question. If I read it right it's saying you need help scraping sites with an endless scroll instead of pagination but the link you provided uses pagination. But the pagination on that site uses javascript so I imagine that you might be having trouble scraping it and I have made an example on how you would scrape that using the 'element click' selector.

{"_id":"a_a_a","startUrl":["https://www.endermologie.com/fr-nos-centres/centre-carte/43.600/7.120/endermologievisage11/fr/antibes/"],"selectors":[{"id":"pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.listing-item","multiple":true,"delay":"3000","clickElementSelector":"li.paginate_button.next","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"name","type":"SelectorText","parentSelectors":["pagination"],"selector":".ficheCentreTitre b","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["pagination"],"selector":"p.infoCentre","multiple":false,"regex":"\d\d \d\d \d\d \d\d \d\d","delay":0}]}

Thank you so much!

finally, i did this the same day:

{"_id":"lpgfranceendormologievisage","startUrl":["https://www.endermologie.com/fr-nos-centres/centre-carte/48.860/2.340/endermologievisage11/fr/Paris"],"selectors":[{"id":"click-pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"td","multiple":true,"delay":"500","clickElementSelector":"li.paginate_button","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"nom","type":"SelectorText","parentSelectors":["click-pagination"],"selector":".ficheCentreTitre b","multiple":true,"regex":"","delay":0},{"id":"détails","type":"SelectorText","parentSelectors":["click-pagination"],"selector":"p","multiple":false,"regex":"","delay":0},{"id":"lien","type":"SelectorLink","parentSelectors":["click-pagination"],"selector":"a","multiple":false,"delay":0}]}

and worked like a charm!

Thanks a lot for your answer :slight_smile:
As you seems to be a pro of scraping, can i ask you another question:

I want to scrap thie embed google map with all those pins : but i am not able to scrap it.. i did it on antoher pages using the html , but for this one.. i am not able to do it.

https://www.hydrojetsystem-france.fr/clients

thx a lot for your help :slight_smile:

Trying to scrape a google search page is a challenge of its own, I'm not sure if scraping one of their maps would be possible. I'm not sure if the 'pins' are even in the HTML, I at least couldn't find them. If you can find the HTML tags for the pins in the code we could probably set up an 'element click' selector but I think they are done via javascript or on the Google side of things.

for exemple, this one with HTML, i can scrape the data on the map, and after clean by my own:
https://www.infrarouges-longs.com/ou-pratiquez.html