Search Engine Existence - Index and Filtering the Web

To begin the entire functionality of a search engine is the ability to crawl, index, and grade webpages. This can then lead to the possibility of classifying and searching for relevant webpages based on complex machine algorithms. This complexity is furthered by the open source nature of the internet. At any point in time anyone can upload or post content whether unique or duplicate. This is where Search Engines like Google create guidelines for their services. This essentially creates the standards by which they accept or reject content from their index. 

---

This filtering is the core component to creating a regulated web. However with this filtered web comes challenges based on human nature. There is a possibility of individuals trying to “game” the Search Engines in order to achieve misguided traffic and sales. There is the potential for this gaming to reach epidemic proportions effectively rendering user and publisher helpless when it comes to naturally allowing search engines to classify and provide query results solely based on content.

---

Because of this epidemic a new element was introduced to the algorithmic filtering. This new element was the association of links in accordance to content. This element has provided a somewhat self-governing system by which content can be judged based on its popularity and relevance to trusted sources.