Please, help with pop ups

Thorser · April 28, 2018, 9:45am

Hello,
I need help with a pop up, where I can find telephone numbers. I was trying it with "Pop up Link" but I dont be able. Please, could you help me?.

Here is the code I'm trying:

{"_id":"milanuncios","startUrl":["https://www.milanuncios.com/coches-de-segunda-mano-en-madrid/?demanda=n&vendedor=part"],"selectors":[{"id":"menu","type":"SelectorLink","selector":"a.aditem-detail-title","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"car","type":"SelectorText","selector":"div.pagAnuTituloBox a","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"ref","type":"SelectorText","selector":"div.pillDiv strong","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"current price","type":"SelectorText","selector":"div.pagAnuPrecioTexto","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"descriptio","type":"SelectorText","selector":"p.pagAnuCuerpoAnu","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"year","type":"SelectorText","selector":"div.ano","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"kms","type":"SelectorText","selector":"div.kms","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"fuel","type":"SelectorText","selector":"div.die","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"doors","type":"SelectorText","selector":"div.ejes","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"transmission","type":"SelectorText","selector":"div.cmanual","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"statistic day","type":"SelectorText","selector":"div.pagAnuStatsCreated","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"views","type":"SelectorText","selector":"div.pagAnuStatsRow:nth-of-type(3) div.paganuStatsColLeft div.pagAnuStatsData","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"contactos","type":"SelectorText","selector":"div.pagAnuStatsRow:nth-of-type(3) div.paganuStatsColRight div.pagAnuStatsData","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"veces compartido","type":"SelectorText","selector":"div.pagAnuStatsRow:nth-of-type(4) div.paganuStatsColLeft div.pagAnuStatsData","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"veces favorito","type":"SelectorText","selector":"div.pagAnuStatsRow:nth-of-type(4) div.paganuStatsColRight div.pagAnuStatsData","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"propietario","type":"SelectorText","selector":"div.pagAnuContactNombre","parentSelectors":["menu"],"multiple":false,"regex":"","delay":0},{"id":"telephone","type":"SelectorPopupLink","selector":"button.pagAnuContactButton","parentSelectors":["menu"],"multiple":false,"delay":"200"}]}

chefas · April 28, 2018, 3:05pm

Hi,

I think its' better to use an "Element Clic" selector.
But as you, I can't scrape the tel.
Perhaps, the site is protected against scraping .

As you I would be very interested to receive more informations about how to use Web scraper in this case

Thorser · April 28, 2018, 8:02pm

Thank you!.

I'll try again but it seems very difficult.

Thank you!

chefas · May 1, 2018, 5:48pm

it's a pleasure to try to help you in the futur

Thorser · May 2, 2018, 12:28pm

Hi!

I was thinking about how can I do the "pop up telephone extract" and I thinking about and option.

The telephone numbers of ALL users are in this kind of page https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=[user reference] where [use reference] you can scrap normally. So, I'm able to scrap the [user reference] and I only to build a lot of web pages with this "https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=" and this "[user reference]".

Do you know how I can I do this?. I suppose that I need scrap a lot of pages...

Thanks

chefas · May 2, 2018, 4:18pm

Hello

not sure to well understand.

Please, give us full http link ( to click ! ) to see what you mean by " ... viewing ALL users are in this kind of pages ...."

Thorser · May 2, 2018, 7:31pm

HI,

For example, the telephone of this car: https://www.milanuncios.com/bmw-de-segunda-mano/bmw-serie-5-525d-automatico-249640236.htm (reference: 249640236), is here: https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=249640236. In this page (https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=249640236) you can scrape the telephone number.

chefas · May 4, 2018, 3:52pm

Hello,

as you can't pass variables to the "Start URL" in the metadata, I can't image how you are going to proceed to get all the telephone numbers .... and the processing will be very long !

{"_id":"test","startUrl":["https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=[249640236-249640250]"],"selectors":[{"id":"telnumber","type":"SelectorText","selector":"div.telefonos","parentSelectors":["_root"],"multiple":false,"regex":"","delay":0}]}

Thorser · May 4, 2018, 4:25pm

Yes, veeeeeery long, but.....

Thorser · May 4, 2018, 4:35pm

You can scrap a lot of “Start url” so is the same like pass a lot of variables. For example:

{"_id":"test","startUrl":["https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=1,"https://milanuncios.com/datos-contacto/?usePhoneProxy=0&id=2,.............],"selectors":[{"id":"telnumber","type":"SelectorText","selector":"div.telefonos","parentSelectors":["_root"],"multiple":false,"regex":"","delay":0}]}

chefas · May 4, 2018, 5:38pm

Sorrry but it's not possible to import this Scrapsite (error JSON).
Could you sent a screen copy to see more

Thorser · May 4, 2018, 5:42pm

Sorry, was an example.

This is the sitemap:

chefas · May 6, 2018, 8:52am

Hello,

Ok I see

I'm not sure if this is a good solution if you have to grab hundreds of URLs by hand.
In "Create a new Sitemap" you have found a way to avoid having to enter all manually one by one:
Url 1 +
Url 2 +
...
Url 42 +

etc.

Thorser · May 6, 2018, 6:24pm

I did it with Excel and its very easy!!!

chefas · May 7, 2018, 1:24pm

Ok to build the list of different links in Excel, but how do you paste all this into the scraper web metadata window?

I can not copy one block, let say 100 URLs , at once in the metadata window of Web scrapper.

I can only do it url by url:
Url1 +
url 2 +
url 3 +
etc.