Scraping with Azure Functions and HTMLAgilityPack
This page shows the movement of prices on the www.weSellCars.co.za website.
Update
This is an update / improvement on the previous scraping post, I also wanted to employ Azure functions and break up the app into discrete well, functions, and Azure Functions “seemed” appropriate. A bit of a learning curve with the function app life cycle and API but works great! I split the app into a scraping and a serving function app using MVC.
- I eventually implemented HttpClient in conjunction with the HTMLAgilityPack in an Azure Functions App, much faster and less brittle.