1. SEJ
  2.  ⋅ 
  3. News

Wikimedia Clarifies it is Not Building a Global Web Crawler

Recently released documents detailed the terms of a grant received by the Wikimedia Foundation to work on a search projected called “Knowledge Engine.” The terms of the grant suggested plans for the nonprofit organization to build a search engine that could potentially compete with Google.

Wikimedia Foundation has responded to reports that have been published since the documents were made public, clarifying what it intends to do and not do.

“What are we not doing? We’re not building a global crawler search engine… Despite headlines, we are not trying to compete with other platforms, including Google. As a non-profit we are noncommercial and support open knowledge. Our focus is on the knowledge contributed on the Wikimedia projects.”

Wikipedia and its sister projects contain over 35 million articles across nearly 300 languages. Citing a need to improve the search and discovery of its projects, Wikimedia Foundation lays out its plans as a result of receiving the grant:

“We intend to research how Wikimedia users seek, find, and engage with content. This essential information will allow us to make critical improvements to discovery on the Wikimedia projects.”

Where the Confusion Came From

Plans for the Knowledge Engine project now sound more ambiguous than what was originally laid out in the grant terms. The documents outline plans to “democratize the discovery of media, news, and information,” by providing an opposition to “commercial search engines.”

In addition, the documents state success of the project may be at risk if “Google, Yahoo, or another big commercial search engine” attempt to develop something similar.

According to what is being described now in Wikimedia’s latest blog post, the organization is working on a new engine for search and discovery within its own projects, driven by community feedback.

That’s quite a contrast to the original grant application documents. At least now there’s some clarification on Wikimedia’s future plans.

Featured Image Credit: dennizn /

Category News
SEJ STAFF Matt G. Southern Senior News Writer at Search Engine Journal

Matt G. Southern, Senior News Writer, has been with Search Engine Journal since 2013. With a bachelor’s degree in communications, ...

Wikimedia Clarifies it is Not Building a Global Web Crawler

Subscribe To Our Newsletter.

Conquer your day with daily search marketing news.