Table row in the script link

How to?
#1

Hello,
I want to get detailed information from https://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa but I can't find the solution, can you help me?
1. click on each page number and save the table. The rows are links but I can't set it. How should I? Can you insert a scraped field (I will expand with the others).

{"_id":"Felnottkepzes","startUrl":["https://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa"],"selectors":[{"id":"Oldalak","parentSelectors":["_root","Oldalak"],"paginationType":"auto","type":"SelectorPagination","selector":"button.p-paginator-page"},{"id":"Tabla","parentSelectors":["Oldalak"],"type":"SelectorTable","multiple":true,"selector":"table","tableDataRowSelector":"tbody","tableHeaderRowSelector":".p-datatable-thead tr","columns":[{"extract":true,"header":"Megnevezés","name":"Megnevezes"},{"extract":true,"header":"Székhely","name":"Szekhely"},{"extract":true,"header":"Nyilv. szám","name":"NyilvantartasiSzam"},{"extract":true,"header":"Engedélyszám","name":"Engedelyszam"}]}]}

2. The other way, clicking on the table row changes the URL. This is very slow because there are >22,000 rows, but a lot of deleted records, about 13,000 records. It is very slow because of the deleted records. Can it be skipped if there is no data on the page? e.g. https://far.nive.hu/nyilvantartasok/felnottkepzok/publikus/20175

{"_id":"Felnottkepzes_Reszletes","startUrl":["https://far.nive.hu/nyilvantartasok/felnottkepzok/publikus/[3-30]"],"selectors":[{"id":"nyilvSzam","parentSelectors":["_root"],"type":"SelectorText","selector":"div.osszesites-field.ng-star-inserted:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"NyilvVeve","parentSelectors":["_root"],"type":"SelectorText","selector":".mb-1 .horizontal-label > span","multiple":false,"regex":""},{"id":"EngedelySzam","parentSelectors":["_root"],"type":"SelectorText","selector":"div.ng-star-inserted:nth-of-type(3) .horizontal-label > span","multiple":false,"regex":""},{"id":"Engedelyezve","parentSelectors":["_root"],"type":"SelectorText","selector":"far-nyilvantartas-adatok > section div:nth-of-type(4) .horizontal-label > span","multiple":false,"regex":""},{"id":"Vallalkozas","parentSelectors":["_root"],"type":"SelectorText","selector":"far-beadvany-osszesites section:nth-of-type(1) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"Azonosito","parentSelectors":["_root"],"type":"SelectorText","selector":"far-beadvany-osszesites div:nth-of-type(4) .horizontal-label > span","multiple":false,"regex":""},{"id":"Adoszam","parentSelectors":["_root"],"type":"SelectorText","selector":"div:nth-of-type(5) .horizontal-label > span","multiple":false,"regex":""},{"id":"Szekhely","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(2) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"Telephely","parentSelectors":["_root"],"type":"SelectorText","selector":"far-beadvany-osszesites div.ng-star-inserted:nth-of-type(2) .horizontal-label > span","multiple":false,"regex":""},{"id":"LevCim","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(3) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"Telefon","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(3) div:nth-of-type(2) .horizontal-label > span","multiple":false,"regex":""},{"id":"eMail","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(3) div:nth-of-type(3) .horizontal-label > span","multiple":false,"regex":""},{"id":"Kepviselo","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(4) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"KepvTisztsege","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(4) div:nth-of-type(2) .horizontal-label > span","multiple":false,"regex":""}]}

Thx, ZS

#2

Hello,
I'm sorry if my description wasn't clear, I'll rephrase it to see if you can help.
URL: http://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa
Clicking on the row of the table acts as a link. So I go through the pages and scrape the table. But the table row as a link is a challenge. What should I add to it? I've tried many things, but I'm stuck.

{"_id":"Felnottkepzes","startUrl":["http://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa"],"selectors":[{"id":"Oldalak","parentSelectors":["_root","Oldalak"],"paginationType":"auto","type":"SelectorPagination","selector":"button.p-paginator-page"},{"id":"Tabla","parentSelectors":["Oldalak"],"type":"SelectorTable","multiple":true,"selector":"table","tableDataRowSelector":"tbody","tableHeaderRowSelector":".p-datatable-thead tr","columns":[{"extract":true,"header":"Megnevezés","name":"Megnevezes"},{"extract":true,"header":"Székhely","name":"Szekhely"},{"extract":true,"header":"Nyilv. szám","name":"NyilvantartasiSzam"},{"extract":true,"header":"Engedélyszám","name":"Engedelyszam"}]}]}

This would be the right way, because it's fast, just going through the live data.
The details change after clicking on the URL.

Link
Link972×242 36.7 KB

This is how I do it now, but it's slow because it takes a long time to load non-live data. Another problem is that there are a lot of URLs, I can only enter 10,000 at a time. So I split it into 3 parts.
Here's a smaller URL count scrape.

{"_id":"Felnottkepzes_Reszletes","startUrl":["http://far.nive.hu/nyilvantartasok/felnottkepzok/publikus/[3-30]"],"selectors":[{"id":"nyilvSzam","parentSelectors":["_root"],"type":"SelectorText","selector":"div.osszesites-field.ng-star-inserted:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"NyilvVeve","parentSelectors":["_root"],"type":"SelectorText","selector":".mb-1 .horizontal-label > span","multiple":false,"regex":""},{"id":"EngedelySzam","parentSelectors":["_root"],"type":"SelectorText","selector":"div.ng-star-inserted:nth-of-type(3) .horizontal-label > span","multiple":false,"regex":""},{"id":"Engedelyezve","parentSelectors":["_root"],"type":"SelectorText","selector":"far-nyilvantartas-adatok > section div:nth-of-type(4) .horizontal-label > span","multiple":false,"regex":""},{"id":"Vallalkozas","parentSelectors":["_root"],"type":"SelectorText","selector":"far-beadvany-osszesites section:nth-of-type(1) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"Azonosito","parentSelectors":["_root"],"type":"SelectorText","selector":"far-beadvany-osszesites div:nth-of-type(4) .horizontal-label > span","multiple":false,"regex":""},{"id":"Adoszam","parentSelectors":["_root"],"type":"SelectorText","selector":"div:nth-of-type(5) .horizontal-label > span","multiple":false,"regex":""},{"id":"Szekhely","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(2) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"Telephely","parentSelectors":["_root"],"type":"SelectorText","selector":"far-beadvany-osszesites div.ng-star-inserted:nth-of-type(2) .horizontal-label > span","multiple":false,"regex":""},{"id":"LevCim","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(3) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"Telefon","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(3) div:nth-of-type(2) .horizontal-label > span","multiple":false,"regex":""},{"id":"eMail","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(3) div:nth-of-type(3) .horizontal-label > span","multiple":false,"regex":""},{"id":"Kepviselo","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(4) div:nth-of-type(1) .horizontal-label > span","multiple":false,"regex":""},{"id":"KepvTisztsege","parentSelectors":["_root"],"type":"SelectorText","selector":"section:nth-of-type(4) div:nth-of-type(2) .horizontal-label > span","multiple":false,"regex":""}]}

Can I specify not to wait where there is no data? e.g. one like this: http://far.nive.hu/nyilvantartasok/felnottkepzok/publikus/20175

Another interesting case, is it possible to save data in a separate file with a key field that should be in a separate table? Here are two examples. In the first one I see the data in one row.

row
row1010×298 40.2 KB

For example: http://far.nive.hu/nyilvantartasok/felnottkepzok/publikus/22203

But I have also seen it in columns, e.g.: http://far.nive.hu/nyilvantartasok/felnottkepzok/publikus/29

columns
columns444×547 42.7 KB

Any ideas how to solve these?
Thx

#3

your web site is absolutely unreachable.....

#4

It's available on my site, it loads (http://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa), I don't know of any access restrictions for viewing from other countries. But you can still... Any idea? Should I take a screenshot? Copy source code snippet?

#5

I copied the URL from Firefox. I find that https is the start, even if http is the original, if you try it that way, does it work? I take the "s" out of the url: http://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa ? Is this how it works ? Sorry if that caused the problem.
URL

#6

unfortunately, not working, even by using VPN
...

#7

I have no idea why you can't reach it, I'm using it from the same country, it works for me unchanged. I have tried Firefox, Chrome, Edge, all OK. Thanks for the experiment, any idea what I can do? Should I look for something in the source that will then treat the script as a link? Have you seen someone similar that I can adapt that I can start with? That would be helpful:

  1. get it to see as a link which is how it works (table row that when clicked on, detailed data appears).
  2. if I go through all the possible URLs with available detail data, if it has been deleted, how can I jump over that because it takes a long time to load, which is very slow. It now takes a few days. Saving the table takes an hour max. Big difference...
    Thx
#8

Last idea, doesn't your browser automatically insert the missing WWW. in the URL? Because 3 browsers work fine if http://far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa but the page is not available like this: http://www.far.nive.hu/publikus-adatok/felnottkepzok-nyilvantartasa
WWW

#9

look, I'm not joking
image

#10

Thank you for checking. I am sad. State run, so it won't change. If no one else can get it, I'll start experimenting to see if I can fix it. Thank you for your time so far.

#11

as an option, you can share your PC screen and I can try to assist.... AnyDesk for example...

#12

I wrote, did you get it?

#13

Where did you wrote to? ))

#14

XXXX.com.ua @ gmail com saw this OK

#15

just checked email... got it...

#16

Thanks again for correcting the solution.

#17

no problem, man... you are welcome )))