Hello Kind Web Scraping Gurus,
I've searched this entire forum and also looked at the Javascript selector documentation but still unable to figure out the solution to this. I'm trying to scrape forum posts for comments but would like to extract the text in the "post" class, but at the same time excluding the text in the "quoteheader" and "quote" classes.
As you can see below, the "quoteheader" and "quote" classes are nested inside the "post" div.
I am able to scrape all the text inside the "post" class, but then the text from the quote gets included as well, and it's going to take a long time to clean the data to remove all the quotes manually.
Was hoping there was a way to extract only the main comment excluding the quotes.
Note: Some posts have quotes and some do not. The ones that don't are not a problem.
<div class="post">
<div class="quoteheader">
<a href="https://randomsite.com/forumtopic=243243">Quote from: Jackson on July 17, 2022, 08:35:11 PM</a>
</div>
<div class="quote">"Hello, i wanna ask what happened with that site?" <br>
</div>
<br>
I ONLY WANT TO EXTRACT THIS TEXT>>> "I thought I'd seen everything on this forum, but seeing someone take the time and spend their precious finger to post what you just posted is something I'm shocked.. do you realize that what you wrote doesn't make any sense?"
</div>
Thanks so much everyone I really appreciate your help!