Not working proprrly

#1

{"_id":"flight_08_02_2025_20","startUrl":["https://www.google.com/travel/flights/search?tfs=CBwQAhoeEgoyMDI1LTAyLTA4agcIARIDS1JLcgcIARIDSkZLQAFAAUgBcAGCAQsI____________AZgBAg&tfu=EgYIACABKAIiAA&hl=en-IN&gl=in&g2lb=4965990%2C4969803%2C72277293%2C72302247%2C72317059%2C72406588%2C72414906%2C72421566%2C72471280%2C72472051%2C72481459%2C72485658%2C72560029%2C72573224%2C72614662%2C72616120%2C72619927%2C72647020%2C72648289%2C72658035%2C72686036%2C72760082%2C72803964%2C72808078%2C72832976&tcfs=EioKCS9tLzAxYzFubRIDR29hGhgKCjIwMjUtMDItMDISCjIwMjUtMDItMDMYAiIYCgoyMDI1LTAyLTAyEgoyMDI1LTAyLTAzUg9IA1UAAOBAWAFYAlgGWAc"],"selectors":[{"id":"all","paginationType":"auto","parentSelectors":["_root","all"],"selector":"div.yR1fYc","type":"SelectorPagination"},{"id":"wrap","multiple":true,"parentSelectors":["all"],"selector":"div.mWxGOe","type":"SelectorElement"},{"id":"from","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".CbjZQb span:nth-of-type(1)","type":"SelectorText"},{"id":"to ","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":"span:nth-of-type(2)","type":"SelectorText"},{"id":"start time","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".dPzsIb span span span span","type":"SelectorText"},{"id":"end time","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".SWFQlc span span span span","type":"SelectorText"},{"id":"date","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".S90skc span:nth-of-type(3)","type":"SelectorText"},{"id":"wrap 2","multiple":true,"parentSelectors":["wrap"],"selector":"div.GQfMl","type":"SelectorElement"},{"id":"Sites","multiple":false,"parentSelectors":["wrap 2"],"regex":"","selector":"div.ogfYpf","type":"SelectorText"},{"id":"price","multiple":false,"parentSelectors":["wrap 2"],"regex":"","selector":".ScwYP span","type":"SelectorText"},{"clickActionType":"real","clickElementSelector":"div.gb_Mc","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":3000,"discardInitialElements":"do-not-discard","id":"back","multiple":true,"parentSelectors":["all"],"selector":"div.gb_Mc","type":"SelectorElementClick"}]}

some one help me with this

#2

Hi, please describe in detail what you are trying to accomplish.

#3

i wanted to fetch data from google travel flights. i want to go through all flights for a particular day but pagination doesn't work properly.

#4

from id wrap it works fine but before wrap I don't know how to make it work

#5

Please check the below setup:

{"_id":"flight_08_02_2025_20","startUrl":["https://www.google.com/travel/flights/search?tfs=CBwQAhoeEgoyMDI1LTAyLTA4agcIARIDS1JLcgcIARIDSkZLQAFAAUgBcAGCAQsI____________AZgBAg&tfu=EgYIACABKAIiAA&hl=en-IN&gl=in&g2lb=4965990%2C4969803%2C72277293%2C72302247%2C72317059%2C72406588%2C72414906%2C72421566%2C72471280%2C72472051%2C72481459%2C72485658%2C72560029%2C72573224%2C72614662%2C72616120%2C72619927%2C72647020%2C72648289%2C72658035%2C72686036%2C72760082%2C72803964%2C72808078%2C72832976&tcfs=EioKCS9tLzAxYzFubRIDR29hGhgKCjIwMjUtMDItMDISCjIwMjUtMDItMDMYAiIYCgoyMDI1LTAyLTAyEgoyMDI1LTAyLTAzUg9IA1UAAOBAWAFYAlgGWAc"],"selectors":[{"id":"wrap","multiple":true,"parentSelectors":["wrapper"],"selector":"_parent_","type":"SelectorElement"},{"extractAttribute":"aria-label","id":"flight-data","multiple":false,"parentSelectors":["wrap"],"selector":"> div > div","type":"SelectorElementAttribute"},{"id":"date","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":"span:contains('Departure') ++","type":"SelectorText"},{"id":"pagination-view-more","paginationType":"auto","parentSelectors":["_root","pagination-view-more"],"selector":"[aria-label=\"View more flights\"]:visible","type":"SelectorPagination"},{"id":"wrapper","multiple":true,"parentSelectors":["_root"],"selector":"[role=\"tabpanel\"] li:visible:not(:has([aria-label=\"View fewer flights\"]))","type":"SelectorElement"}]}
#6

Screenshot (1)
Screenshot (1)1880×958 88.5 KB

thanks i tried it but i want to get the data from all flights so that i can compare different site pricings

{"_id":"flight_test","startUrl":["https://www.google.com/travel/flights/search?tfs=CBwQAhoeEgoyMDI1LTAyLTA4agcIARIDS1JLcgcIARIDSkZLQAFAAUgBcAGCAQsI____________AZgBAg&tfu=EgYIACABKAIiAA&hl=en-IN&gl=in&g2lb=4965990%2C4969803%2C72277293%2C72302247%2C72317059%2C72406588%2C72414906%2C72421566%2C72471280%2C72472051%2C72481459%2C72485658%2C72560029%2C72573224%2C72614662%2C72616120%2C72619927%2C72647020%2C72648289%2C72658035%2C72686036%2C72760082%2C72803964%2C72808078%2C72832976&tcfs=EioKCS9tLzAxYzFubRIDR29hGhgKCjIwMjUtMDItMDISCjIwMjUtMDItMDMYAiIYCgoyMDI1LTAyLTAyEgoyMDI1LTAyLTAzUg9IA1UAAOBAWAFYAlgGWAc"],"selectors":[{"id":"all","paginationType":"auto","parentSelectors":["_root","all"],"selector":"div.yR1fYc","type":"SelectorPagination"},{"id":"wrap","multiple":false,"parentSelectors":["all"],"selector":"div.mWxGOe","type":"SelectorElement"},{"id":"from","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".CbjZQb span:nth-of-type(1)","type":"SelectorText"},{"id":"to ","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":"span:nth-of-type(2)","type":"SelectorText"},{"id":"start time","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".dPzsIb span span span span","type":"SelectorText"},{"id":"end time","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".SWFQlc span span span span","type":"SelectorText"},{"id":"date","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".S90skc span:nth-of-type(3)","type":"SelectorText"},{"id":"wrap 2","multiple":true,"parentSelectors":["wrap"],"selector":"div.GQfMl","type":"SelectorElement"},{"id":"Sites","multiple":false,"parentSelectors":["wrap 2"],"regex":"","selector":"div.ogfYpf","type":"SelectorText"},{"id":"price","multiple":false,"parentSelectors":["wrap 2"],"regex":"","selector":".ScwYP span","type":"SelectorText"},{"clickActionType":"real","clickElementSelector":"div.gb_Mc","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":3000,"discardInitialElements":"discard-when-click-element-exists","id":"back","multiple":true,"parentSelectors":["all"],"selector":"div.gb_Mc","type":"SelectorElementClick"}]}

this one works but it opens every flights 2 times .

#7

try adding :visible to the first selector

#8

I'm sorry but where should i put that ?

#9

image

#10

i tried it but still it opens 2 time. is it because of using link selector to go back to the initial page?

#11

Try this sitemap:

{"_id":"flight_test","startUrl":["https://www.google.com/travel/flights/search?tfs=CBwQAhoeEgoyMDI1LTAyLTA4agcIARIDS1JLcgcIARIDSkZLQAFAAUgBcAGCAQsI____________AZgBAg&tfu=EgYIACABKAIiAA&hl=en-IN&gl=in&g2lb=4965990%2C4969803%2C72277293%2C72302247%2C72317059%2C72406588%2C72414906%2C72421566%2C72471280%2C72472051%2C72481459%2C72485658%2C72560029%2C72573224%2C72614662%2C72616120%2C72619927%2C72647020%2C72648289%2C72658035%2C72686036%2C72760082%2C72803964%2C72808078%2C72832976&tcfs=EioKCS9tLzAxYzFubRIDR29hGhgKCjIwMjUtMDItMDISCjIwMjUtMDItMDMYAiIYCgoyMDI1LTAyLTAyEgoyMDI1LTAyLTAzUg9IA1UAAOBAWAFYAlgGWAc"],"selectors":[{"id":"all","paginationType":"clickOnce","parentSelectors":["_root","all"],"selector":"div.yR1fYc:visible","type":"SelectorPagination"},{"id":"wrap","multiple":false,"parentSelectors":["all"],"selector":"div.mWxGOe","type":"SelectorElement"},{"id":"from","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".CbjZQb span:nth-of-type(1)","type":"SelectorText"},{"id":"to ","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":"span:nth-of-type(2)","type":"SelectorText"},{"id":"start time","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".dPzsIb span span span span","type":"SelectorText"},{"id":"end time","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".SWFQlc span span span span","type":"SelectorText"},{"id":"date","multiple":false,"parentSelectors":["wrap"],"regex":"","selector":".S90skc span:nth-of-type(3)","type":"SelectorText"},{"id":"wrap 2","multiple":true,"parentSelectors":["wrap"],"selector":"div.GQfMl","type":"SelectorElement"},{"id":"Sites","multiple":false,"parentSelectors":["wrap 2"],"regex":"","selector":"div.ogfYpf","type":"SelectorText"},{"id":"price","multiple":false,"parentSelectors":["wrap 2"],"regex":"","selector":".ScwYP span","type":"SelectorText"},{"clickActionType":"real","clickElementSelector":"div.gb_Mc","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":3000,"discardInitialElements":"discard-when-click-element-exists","id":"back","multiple":true,"parentSelectors":["all"],"selector":"div.gb_Mc","type":"SelectorElementClick"}]}
#12

Thank you soo much it worked. was it a back button issue from my side?

#13

I adjusted the pagination type:
image

1 Like