Hi，
I want to scrape the list of like from the LinkedIn company page. For some companies(with a little number of posts), it works. For others(with a large number of posts), it doesn't work.
Works: https://www.linkedin.com/company/robustel/posts/?feedView=all
Doesn't work: https://www.linkedin.com/company/milesightiot/posts/?feedView=all
Here is the map:
{"_id":"likelist","startUrl":["https://www.linkedin.com/company/milesightiot/posts/?feedView=all"],"selectors":[{"id":"scroll","parentSelectors":["_root"],"type":"SelectorElementScroll","selector":".feed-shared-update-v2 > div","multiple":true,"delay":0},{"id":"dianzan","parentSelectors":["_root"],"type":"SelectorElementClick","clickElementSelector":"span.social-details-social-counts__social-proof-text,span.social-details-social-counts__reactions-count","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":0,"discardInitialElements":"do-not-discard","multiple":true,"selector":"div.artdeco-modal"},{"id":"showmore","parentSelectors":["dianzan"],"type":"SelectorElementClick","clickElementSelector":"button:contains('Show more results')","clickElementUniquenessType":"uniqueText","clickType":"clickMore","delay":1000,"discardInitialElements":"do-not-discard","multiple":true,"selector":"div.artdeco-entity-lockup"},{"id":"profile","parentSelectors":["dianzan"],"type":"SelectorElement","selector":"li","multiple":true,"delay":0},{"id":"close","parentSelectors":["dianzan"],"type":"SelectorElementClick","clickElementSelector":"button.artdeco-modal__dismiss","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":1000,"discardInitialElements":"do-not-discard","multiple":false,"selector":".artdeco-modal__dismiss li-icon"},{"id":"name","parentSelectors":["profile"],"type":"SelectorText","selector":".artdeco-entity-lockup__title span","multiple":false,"delay":0,"regex":""},{"id":"headline","parentSelectors":["profile"],"type":"SelectorText","selector":"div.artdeco-entity-lockup__caption","multiple":false,"delay":0,"regex":""},{"id":"link","parentSelectors":["profile"],"type":"SelectorLink","selector":"a","multiple":false,"delay":0},{"id":"avatar","parentSelectors":["profile"],"type":"SelectorImage","selector":"img.ivm-view-attr__img--centered","multiple":false,"delay":0}]}
The structure:
1, Load all post
2, click “Like Amount Button.” Then, like list pop up.
3, Load all profiles
4, Scrap info
5, Close Popup
6. Move to the next post like list
I don't know why it doesn't work on some pages, for example, Milesight IoT