IronWebScraper

IronWebScraper

IronWebScraper makes it easy to find and read content from websites in C#

It makes Web Scraping in C# easy, providing a tool for you to scrape the content of websites.

Web Scraping in C# or .Net

IronWebScraper is an advanced web scraping library written in C#. It uses web scraping algorithms to read structured content from websites. This is ideal for scraping content from multiple existing websites or intranet applications to build the content for your web application or archive. IronWebScraper can provide the tool you need to index your content for use by your search application or cataloging system. IronWebScraper uses C# to provide a reliable, enterprise class web scrpaer in an easy to use DLL library.

The IronWebScraper API is easy to use. Most C# developers will be up and running in no time using the Nuget installer for Visual Studio.

Migrating Websites to Databases

IronWebScraper provides the tools and methods to allow you to re-engineer your websites back into structured databases.   This technology is useful when migrating content from legacy websites and intranets into your new C# application.

Populating Search Indexes

IronWebScraper is an ideal tool to scrape content for your search index.   A search application such as IronSearch can read structured content from IronWebScraper to build a powerful enterprise search system.

What's New with IronWebScraper (4.0.4.2)

• Politely auto-thottle by Domain & IP Address
• Massively multi-threaded behind the scenes
• Parse HTML using XPath, JavaScript or jQuery style DOM queries.
• Pause and Resume functionality