Hello,
I have a bug when I try the scrap an html element.
The problem occurs here in my site map:
{
"id": "adresse",
"type": "SelectorHTML",
"parentSelectors": [
"url"
],
"selector": "span[itemprop='streetAddress']",
"multiple": false,
"regex": "",
"delay": 0
}
When the data contains an the columns that follows become empty.
Maybe a regex can help ?
Sitemap:
{
"_id": "scrap",
"startUrl": [
"https://magasins.wurth.fr/quincaillerie/"
],
"selectors": [
{
"id": "url",
"type": "SelectorLink",
"parentSelectors": [
"_root"
],
"selector": "a.proxiSommaireLink",
"multiple": true,
"delay": 0
},
{
"id": "adresse",
"type": "SelectorHTML",
"parentSelectors": [
"url"
],
"selector": "span[itemprop='streetAddress']",
"multiple": false,
"regex": "",
"delay": 0
},
{
"id": "codepostal",
"type": "SelectorText",
"parentSelectors": [
"url"
],
"selector": "span[itemprop='postalCode']",
"multiple": false,
"regex": "",
"delay": 0
},
{
"id": "tel",
"type": "SelectorText",
"parentSelectors": [
"url"
],
"selector": "span[itemprop='telephone']",
"multiple": false,
"regex": "",
"delay": 0
},
{
"id": "horaires",
"type": "SelectorHTML",
"parentSelectors": [
"url"
],
"selector": "#infos li > p",
"multiple": false,
"regex": "",
"delay": 0
},
{
"id": "mail",
"type": "SelectorText",
"parentSelectors": [
"url"
],
"selector": "#ContentPlaceHolderDefault_ContentPlaceHolderCentreDeLaPage_Magasin_HL_Email",
"multiple": false,
"regex": "",
"delay": 0
},
{
"id": "latitude",
"type": "SelectorElementAttribute",
"parentSelectors": [
"url"
],
"selector": "meta[itemprop=\"latitude\"]",
"multiple": false,
"extractAttribute": "content",
"delay": 0
},
{
"id": "longitude",
"type": "SelectorElementAttribute",
"parentSelectors": [
"url"
],
"selector": "meta[itemprop=\"longitude\"]",
"multiple": false,
"extractAttribute": "content",
"delay": 0
}
]
}
Exemple
web-scraper-order;web-scraper-start-url;url;url-href;adresse;codepostal;tel;horaires;mail;latitude;longitude
1582881602-78;https://magasins.wurth.fr/quincaillerie/;Melun;https://magasins.wurth.fr/quincaillerie/quincaillerie-melun/;<p>5 Rue de la Plaine de la Croix Besnard</p> <p> ;;;;;