Search engine scraping: Difference between revisions

Revision as of 18:29, 16 April 2023

Revision as of 05:33, 25 April 2023

Line 69:

== Legal ==

When scraping websites and services the legal part is often a big concern for companies, for web scraping it greatly depends on the country a scraping user/company is from as well as which data or website is being scraped. With many different court rulings all over the world.<ref>{{cite web|url=http://blog.icreon.us/advise/web-scraping-legality|title=Is Web Scraping Legal? |publisher=Icreon (blog)}}</ref><ref>{{cite web|url=https://arstechnica.com/tech-policy/2014/04/appeals-court-reverses-hackertroll-weev-conviction-and-sentence/|title=Appeals court reverses hacker/troll "weev" conviction and sentence [Updated]|website=arstechnica.com|date=11 April 2014 }}</ref><ref>{{cite news |title=App store optimization services |url=https://asoservice.com/ |access-date=17 April 2023}}</ref><ref>{{cite web|url=https://www.techdirt.com/articles/20090605/2228205147.shtml|title=Can Scraping Non-Infringing Content Become Copyright Infringement... Because Of How Scrapers Work?|website=www.techdirt.com|date=10 June 2009 }}</ref>

However, when it comes to scraping search engines the situation is different, search engines usually do not list intellectual property as they just repeat or summarize information they scraped from other websites.

Line 83:

==External links==

{{toomanylinks}}

* [https://scrapy.org/ Scrapy] Open source python framework, not dedicated to search engine scraping but regularly used as base and with a large number of users.

* [http://scraping.compunect.com Compunect scraping sourcecode] - A range of well known open source PHP scraping scripts including a regularly maintained Google Search scraper for scraping advertisements and organic resultpages.

Line 89 ⟶ 90:

* [http://simplehtmldom.sourceforge.net/ PHP Simpledom] A widespread open source PHP DOM parser to interpret HTML code into variables.

*[https://serpapi.com/ SerpApi] Third party service based in the United States allowing you to scrape search engines legally.

*[https://toolsgator.com/ Tools Gator] Our SEO tool is a comprehensive platform designed to help businesses improve their online visibility and rank higher in search engine results.

[[Category:Search engine software]]