Hello,
This is my first message here. I have neither background in web scraping nor any basic programming knowledge. Before posting, I ran a search and found this thread, yet I need a specific tutorial in order to understand what I should do with what's written there.
Therefore, I'd greatly appreciate any help dealing with the following project:
I am working on a registry for a specific GM car model of a certain year. In that year, there were a bit more than 20,000 cars made. Except for the production number that changes, there are also a digit for the body type, another one for the engine type and also a check digit (0-9 or X). It means that for each VIN, there are 44 combinations, from which only one is a real VIN of an existing car. it also means that about 950,000 VIN options would have to be checked in order to obtain the 20,000+ real VIN codes.
BTW, the URL structure stays the same. It's only the VIN that changes. For example:
http://www.[domain].com/vin/1FDUF4HY8CEA00001
http://www.[domain].com/vin/1FDUF4HY8CEA00002
http://www.[domain].com/vin/1FDUF4HY8CEA00003
and so on.
This is the site I'm using. The output contains all RPO codes for any given VIN. This is what I'm after. If you enter a false VIN (and there will be 43 false strings for each production number), there is no error message. The output is just blank. Tried to start this manually but the server banned me after running several VIN codes consecutively (I got a "too many attempts" type of message) so I could only return the site the day after. Besides that, it doesn't make any sense to run ~950,000 codes manually so this is my reason for using WS.
Thanks in advance to anyone who might be able to help me!
