Hi guys,
sorry, bit of a newbie here.
I'm trying to go through users in Mailchimp to collect their activities via scraping (looking for exporting their timeline but mailchimp doesn't really help me do so).
So, i start from user page
i collect user's data (text) (1)
i collect his activity (text) (2)
then i click on the next user link, and so on. (3)
It does seem pretty linear to me.
Anyway, i can't understand why sometimes the process stops after 4-5 iterations, sometimes it goes on for 115 users or so, but when i go "refresh data" it only displays me the last one scraped.
Can you please help me?
(i can't give you the link, it's password protected, but i will upload a ss with the datafields i'm trying to scrape).
Url:
Sitemap:
{{"_id":"mc_insider","startUrl":["https://us1.admin.mailchimp.com/lists/members/view?id=428099585&use_segment=Y"],"selectors":[{"id":"dati anagrafici","type":"SelectorText","parentSelectors":["element"],"selector":"div#dijit__WidgetsInTemplateMixin_3.padding-top--lv4 ul.padding-top--lv2","multiple":false,"regex":"","delay":0},{"id":"activity feed","type":"SelectorText","parentSelectors":["element"],"selector":"div.activity-feed","multiple":false,"regex":"","delay":0},{"id":"element","type":"SelectorElement","parentSelectors":["_root","pag"],"selector":"div.contact-profile-content-container","multiple":false,"delay":0},{"id":"pag","type":"SelectorLink","parentSelectors":["_root","pag"],"selector":"a.button:nth-of-type(2)","multiple":false,"delay":0}]}}