[login to view URL] Scraper/Crawler
OVERVIEW:
Fetch prices, seller username, and seller reputation number of books with specified book condition.
CHALLENGES:
[login to view URL] implemented difficult URLs so that you cannot go directly to a page without using their search function by passing an ISBN number.
TECHNICAL REQUIREMENTS:
Build a crawler and scraper that returns and array of prices, book seller username and reputation number when the function is passed on ISBN and condition of the book.
SOLUTION:
The only way to go to the book's product/landing page is by using this link: [login to view URL]
You will need to automatically identify and crawl book conditions when specified. For example, if I ask the script to fetch all "Brand New" prices of ISBN 0072991593, then you would get the prices from this page, [login to view URL], which can only be crawled from the link "View all Brand New Items".
I would like to solution to be developed ideally using Open Source.
If you have any further questions, please don't hesitate to PM me.
Thank you