https://proxiesapi.com/articles/scraping-multiple-pages-in-csharp-with-htmlagilitypack
Scraping Multiple Pages in CSharp with HtmlAgilityPack | ProxiesAPI
Web scraping in C# using HtmlAgilityPack to extract data from multiple pages. Use proxies for scaling up and avoiding IP blocks.
multiple pagesscrapingcsharphtmlagilitypack
https://www.simonmourier.com/blog/-System-Net-WebException-in-HtmlAgilityPack-using-Parallel-ForEach-loop/
Simon Mourier's Blog - 'System.Net.WebException' in HtmlAgilityPack using Parallel.ForEach loop
I think it's because you have a limit on the maximum number of simultaneous HttpWebRequest connections to a site. Check this .NET setting: ConnectionManagement...