Data preview work but when scrape it said "no data extracted", please help!

How to?
#1

Hi guys, i am newbie here,
i got trouble when scraping this website,
i do data preview and it works but when i tried to scrape it wont record anything and said "no data extracated" many times edit the probability but got nothing.
thanks for your time guys,

Url:https://www.upwork.com/o/jobs/browse/?sort=recency

Sitemap:
{"_id":"upwork","startUrl":["https://www.upwork.com/o/jobs/browse/?sort=recency"],"selectors":[{"id":"tittle","type":"SelectorLink","parentSelectors":["_root","page"],"selector":"a.job-title-link","multiple":true,"delay":"0"},{"id":"main_tittle","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.content h2.m-0-bottom","multiple":false,"regex":"","delay":0},{"id":"hastag","type":"SelectorText","parentSelectors":["tittle"],"selector":"a.specialization","multiple":false,"regex":"","delay":0},{"id":"posted ","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.m-md-top span.no-close-lg","multiple":false,"regex":"","delay":0},{"id":"Job Desc","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.job-description div","multiple":false,"regex":"","delay":0},{"id":"needed","type":"SelectorText","parentSelectors":["tittle"],"selector":"strong.d-block","multiple":false,"regex":"","delay":0},{"id":"data 1","type":"SelectorText","parentSelectors":["tittle"],"selector":"ul.job-features li:nth-of-type(1) strong","multiple":false,"regex":"","delay":0},{"id":"data 2","type":"SelectorText","parentSelectors":["tittle"],"selector":"li:nth-of-type(2) strong span.d-none","multiple":false,"regex":"","delay":0},{"id":"data 3","type":"SelectorText","parentSelectors":["tittle"],"selector":"li:nth-of-type(3) strong span.d-none","multiple":false,"regex":"","delay":0},{"id":"data 2a","type":"SelectorText","parentSelectors":["tittle"],"selector":"section.air-card-divider-sm.p-0-top span","multiple":false,"regex":"","delay":0},{"id":"data 2b","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6:nth-of-type(1) li.justify-xs-md:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"data 3a","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6:nth-of-type(2) li.justify-xs-md:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"data 3b","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6:nth-of-type(2) li.justify-xs-md:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"data 3c","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6 li.justify-xs-md:nth-of-type(3)","multiple":false,"regex":"","delay":0},{"id":"data 3d","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6 li.justify-xs-md:nth-of-type(4)","multiple":false,"regex":"","delay":0},{"id":"data 3e","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(5)","multiple":false,"regex":"","delay":0},{"id":"client status","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.m-md-bottom strong","multiple":false,"regex":"","delay":0},{"id":"client country","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.sidebar li.justify-xs-md:nth-of-type(1) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client 1a","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(2) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client 1b","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(2) div.text-muted","multiple":false,"regex":"","delay":0},{"id":"client 1c","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(3) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client 1d","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(3) div.text-muted","multiple":false,"regex":"","delay":0},{"id":"client 1e","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(4) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client 1f","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(4) div.text-muted","multiple":false,"regex":"","delay":0},{"id":"client date created","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.m-0-bottom small.text-muted","multiple":false,"regex":"","delay":0},{"id":"page","type":"SelectorElementClick","parentSelectors":["_root","page"],"selector":"li.pagination-next a","multiple":false,"delay":"1500","clickElementSelector":"li.pagination-next a","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueHTMLText"}]}

#2

Hey - Here is a hack that get's you the what you want. I've used dynamic URL (see metadata) to cycle through all 500 pages based on the URL changing. Some of your text selectors are wonky, you'll need to fix them but this get;s you most of it.

{"_id":"upwork","startUrl":["https://www.upwork.com/o/jobs/browse/?sort=recency","https://www.upwork.com/o/jobs/browse/?page=[2-500]&sort=recency"],"selectors":[{"id":"tittle","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.job-title-link","multiple":true,"delay":"0"},{"id":"main_tittle","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.content h2.m-0-bottom","multiple":false,"regex":"","delay":0},{"id":"hastag","type":"SelectorText","parentSelectors":["tittle"],"selector":"a.specialization","multiple":false,"regex":"","delay":0},{"id":"posted ","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.m-md-top.nowrap","multiple":false,"regex":"","delay":0},{"id":"Job Desc","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.job-description div","multiple":false,"regex":"","delay":0},{"id":"needed","type":"SelectorText","parentSelectors":["tittle"],"selector":".jobdetails-tier-level-icon:first+","multiple":false,"regex":"","delay":0},{"id":"Job-Pay-Type","type":"SelectorText","parentSelectors":["tittle"],"selector":"li:nth-of-type(1) small.text-muted","multiple":false,"regex":"","delay":0},{"id":"Project Length","type":"SelectorText","parentSelectors":["tittle"],"selector":"ul.job-features li:nth-of-type(2) strong","multiple":false,"regex":"","delay":0},{"id":"Level","type":"SelectorText","parentSelectors":["tittle"],"selector":"li:nth-of-type(3) strong span.d-none","multiple":false,"regex":"","delay":0},{"id":"data 2a","type":"SelectorText","parentSelectors":["tittle"],"selector":"section.air-card-divider-sm.p-0-top span","multiple":false,"regex":"","delay":0},{"id":"data 2b","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6:nth-of-type(1) li.justify-xs-md:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"data 3a","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6:nth-of-type(2) li.justify-xs-md:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"data 3b","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6:nth-of-type(2) li.justify-xs-md:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"data 3c","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6 li.justify-xs-md:nth-of-type(3)","multiple":false,"regex":"","delay":0},{"id":"data 3d","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.col-lg-6 li.justify-xs-md:nth-of-type(4)","multiple":false,"regex":"","delay":0},{"id":"data 3e","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(5)","multiple":false,"regex":"","delay":0},{"id":"client status","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.sidebar li.justify-xs-md:nth-of-type(1) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client country","type":"SelectorText","parentSelectors":["tittle"],"selector":"div.sidebar li.justify-xs-md:nth-of-type(1) strong.primary","multiple":false,"regex":"","delay":0},{"id":"Job Posted","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(2) strong.primary","multiple":false,"regex":"","delay":0},{"id":"Job-Posted_Sub","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(2) div.text-muted","multiple":false,"regex":"","delay":0},{"id":"client 1c","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(3) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client 1d","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(3) div.text-muted","multiple":false,"regex":"","delay":0},{"id":"client 1e","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(4) strong.primary","multiple":false,"regex":"","delay":0},{"id":"client 1f","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.justify-xs-md:nth-of-type(4) div.text-muted","multiple":false,"regex":"","delay":0},{"id":"client date created","type":"SelectorText","parentSelectors":["tittle"],"selector":"li.m-0-bottom small.text-muted","multiple":false,"regex":"","delay":0}]}

1 Like
#3

woah, it works, thank you very much bretfeig for helping me, the data is work like cham, you are the real Hero here, i hope i can reply your kindness in the future,

regards,

fiaghost

#4