Please help! Cant find a solution!

Hello everybody!

Help needed! i really love this software and make good use of it. But i have one problem; i want to track auction results of one specifiek site.

This site automatic loads new results/lot numers when you scroll down; i've read for hours and tried almost every option but i cant find a working solution. I really hope this is possible with this software because everything else works great.

Is there somebody who can try this for me with a regular auction?

The selector 'link' works but then he skips several results

thanks in advance en greets

Post your sitemap if you want help. You’ll get a quicker response.


Here is the sitemap. I cant figure out how to navigate to the several pages one by one. And if it is working; it skips several results. Hopefully somebody can give me the right instructions

Man this is a tough one.

Looks like it will only scrape what is in view.

The alternative is use their api to get all listing data, and parse that instead.

That will show you up to 999 listings in that category, from there you can use jq and a script or cron job to pull the data, and feed it into something that can parse it or feed it through jq to reformat / extract the data you want (i.e. the title)

Hope that helps

Thanks for your reaction. Bad news that it isn't possible to scrape directly. The dynamical loading of the site makes it really dificult.

Your api 'solution' is hard to understand for me; not familiar with that kind of technique.

Other question; if i use the link selector and select all the pages, it will include automatic the next button (volgende). is it possible to undo this and only select the pages?

The problem is, it will only scrape the posting that are in view (6 posts, for me) so I would scrape item 1 - 6, 10-16, 20-26, etc if I used the next button.

Heres an easier way to use the API.

  1. Goto and copy the whole page.

  2. Next, go to & click "Paste raw data"

  3. Paste the what we copied previously there and make sure CSV is selected then click "Conver to CSV"

  4. Go ahead and delete all of the source fields except for $.results[*].t

$.results[*].t = Title of the post

  1. If you want more fields, these ones are noteworthy I guess

$.results[].lc = List Category
].d = Item Description (under post title on the listing page)
$.results[].mf = Manufacture
] = Serial Number of device
$.results[].typ = Type
].yb = Year
$.results[*].url = url to detail page (minus

  1. After you have deleted fields you do not want and then click Save scheme and continue

  2. Then when it is finished click Download file

Hi Jeremy,

thanks for your help! i didn't succeed to extract the data. This is totally new for me. The problem is that i can open the api-adress.

How do you resolve this adress of an auction?

Couldn't open it either, until I removed a "1" from the end. Then it worked

So what you want to do is goto and click "Input a URL", paste & click CSV & then Convert to CSV

That page contains all the information you wanted, title of the auction + all the data for each item (displayed on the items page)

After you click Convert to CSV, it will take you to a page to map the extracted data

It will have 3 columns, Source field, Result field name, Type

Do not touch Source field.

Result field name are column names, so you can edit those to what you want in the final CSV.

Go ahead and click the trashcan icon next to the lines you do not need/want

$.results[].t = Title of the post
$.results[].lc = List Category
$.results[].d = Item Description (under post title on the listing page)
$.results[].mf = Manufacture
$.results[] = Serial Number of device
$.results[].typ = Type
$.results[].yb = Year
].url = url to detail page (minus

After you are done click Save schema and continue

Download the CSV

To resolve the urls of the items, just prepend to them all

Might be easiest to copy the json into notepad++ and use find/replace

Find: "url": "
Replace: "url": "

Then copy that and convert it to CSV

1 Like


i managed to pull out the data. Not yet a clean result but iam working on it.

Can somebody please tell me how to resolve an api adress of other auctions ?

Goto any of the listing pages

in chrome/opera right click anywhere and click "Inspect element"

Click on the Network tab and press F5

Find the connection to ""
For me it was Named "100?100&buildversion=201807311"

You can copy that url or you can click on the Response tab to get the json data

Copy all the data in the box and paste it to parse, or just use that url

1 Like

thanks! really appreciate your help. Been a whila ago but still working on it! And making progress, thanks so far!

Over the past few years, I have used the solution mentioned above extensively. Unfortunately, the website mentioned above has been reset. I am now unable to retrieve the data via an API. I am not very experienced. Can anyone help me figure out where I should now use the API and data?