The act of extracting data from public websites is legal in many cases, however, in certain cases, it is considered to be illegal or against web scraping best practices to do so due to specific data ownership laws that govern the data being extracted. Typically, this is the case when the terms and conditions explicitly state web scraping isn’t allowed, or when extracting the data would breach data privacy and copyright laws.

At Web Scrape, we have a data extraction solution to suit any requirement. We can offer once-off data dumps, data subscriptions or professional services arrangements to help you get the data you need in the way you need it.

When you submit your project request, a member of our solution architecture team will discuss with you your project requirements in more detail and propose the best solution to meet your needs.

Once you’ve submitted your project request, a member of our solution architecture team will reach out to you to set up a project discovery call. There the solution architect will discuss your project in detail and gather the information they need to develop the optimal solution to meet your requirements. Within a couple of days, he/she will then present you with this solution for your approval. 

All our crawlers are built using C#, the open-source web scraping framework our team created. Additionally, we use numerous other open-source frameworks that we’ve developed that ensure you’re not locked into using proprietary technology. 

At Web Scrape, we specialize in developing data extraction solutions for projects with mission-critical business requirements. As a result, our number one priority is delivering high quality to our clients. To accomplish this we have implemented a four-layer QA process that continuously monitors the health of our crawls and the quality of the extracted data. 

Setup fees may apply, subject to the nature of the project (once-off, subscription, custom), the complexity of the sites, and the number of records being extracted. Our solution architecture team will assess each site on a case by case basis and you will be provided a final quote for approval

Support is available to all of our customers. We offer support for coverage issues, missed deliveries, minor site changes, etc. Should there be a larger change on the site and the spider needs a complete overhaul – this may fall outside standard support offering and may incur an additional cost – however – this is rare.