I am only getting 10 results per scrape. What am I doing wrong?

#1

{"_id":"union2","startUrl":["Welcome / UNION a","type":"SelectorLink"},{"id":"email","multiple":false,"parentSelectors":["Comp"],"regex":"","selector":".u-flex-col .u-truncate a","type":"SelectorText"},{"id":"web","multiple":false,"parentSelectors":["Comp"],"regex":"","selector":".u-flex.u-mt-2 a","type":"SelectorText"},{"id":"about","multiple":false,"parentSelectors":["Comp"],"regex":"","selector":"p:nth-of-type(2)","type":"SelectorText"},{"elementLimit":0,"id":"scrol","multiple":true,"parentSelectors":["_root"],"scroll":true,"selector":".u-text-lg a","type":"SelectorElement"}]}

#2

Hi,

Please post the sitemap as Preformatted text; otherwise, the JSON is broken.

code

#3 
{"_id":"union2","startUrl":["https://union.vc/capital_factory/directory/companies?sort=name&traits%5Bindustries%5D%5B%5D=supply-chain-logistics&traits%5Bindustries%5D%5B%5D=delivery-services&traits%5Bindustries%5D%5B%5D=shipping-maritime&traits%5Bindustries%5D%5B%5D=supply-chain-management&traits%5Bindustries%5D%5B%5D=storage&traits%5Bindustries%5D%5B%5D=energy&traits%5Bindustries%5D%5B%5D=industrial-automation&traits%5Bindustries%5D%5B%5D=industrial-operations-management&traits%5Bindustries%5D%5B%5D=manufacturing&traits%5Bindustries%5D%5B%5D=aerospace-a86dcc60-7f32-4c60-af12-6072f1dd7a09&traits%5Bindustries%5D%5B%5D=rockets-rocket-engines&traits%5Bindustries%5D%5B%5D=satellites&traits%5Bindustries%5D%5B%5D=space-resources-mining&traits%5Bindustries%5D%5B%5D=space-tourism"],"selectors":[{"id":"Comp","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".u-text-lg a","type":"SelectorLink"},{"id":"email","multiple":false,"parentSelectors":["Comp"],"regex":"","selector":".u-flex-col .u-truncate a","type":"SelectorText"},{"id":"web","multiple":false,"parentSelectors":["Comp"],"regex":"","selector":".u-flex.u-mt-2 a","type":"SelectorText"},{"id":"about","multiple":false,"parentSelectors":["Comp"],"regex":"","selector":"p:nth-of-type(2)","type":"SelectorText"},{"elementLimit":0,"id":"scrol","multiple":true,"parentSelectors":["_root"],"scroll":true,"selector":".u-text-lg a","type":"SelectorElement"}]}
#4

Hi,

Is the data available without a login?

#5

No unfortunatelyu it is not

#6

Unfortunately, I will not be able to troubleshoot the issue without being able to access the HTML.