Zach Vorhies

Google Leaks: Realtime Events monitoring

This document details Google's methods of detecting trends by semantically merging similar stories across news platforms.

So what happens with this data? See: Google "Realtime Boost".pdf

The uses cases that this engine was built on include the Trump-Comey-Russian-Collusion story and sporting events

Part of the full Google Disclosure, which you can see here.
PDF link.

What this document shows

This internal Google presentation describes how Google detects news trends by semantically merging similar stories across news platforms. The use cases the engine was built on include the Trump-Comey-Russian-Collusion story and sporting events. The trends it detects feed "Realtime Boost", which decides which trends to boost.

Key quotes from the document

Quoted verbatim from the "Realtime Events" presentation (May 16, 2017):

  • Realtime - Realtime detection of news-events - Under 5 minutes after event started.
  • Query Understanding - Search currently trending Events for the Query. Also for Query-less, using list of Entities / Salient Terms / Google-Now profile
  • Trump Fires Comey - News Cluster. The Original Cluster has been transformed into everything Comey/Russia/Trump
  • News Cluster is active for 8 days. 18,549 articles so far
  • Story can develop over many days, even months. Event is a new development inside a Story. Takes place over a few hours, not more

Sources and further reading

About the Google Leaks disclosure

This page is part of the Google Leaks: 950+ pages of internal Google documents that Zach Vorhies, a Senior Software Engineer at Google and YouTube for 8.5 years, took with him when he resigned from Google in June 2019. He delivered them to the antitrust division of the U.S. Department of Justice in August 2019 and released them to the public through Project Veritas. The documents describe, in Google's own words, how Google defined "fake news", built its "Machine Learning Fairness" system and kept blacklists across Google Search, YouTube and Google News. He tells the full story in his book Google Leaks: An Expose of Big Tech Censorship (Skyhorse Publishing).

Read the full archive on the Google Leaks page, the dated sequence of events in the timeline, and who Zach Vorhies is on the about page.

Document pages

Realtime Events monitoring, page 1 Realtime Events monitoring, page 2 Realtime Events monitoring, page 3 Realtime Events monitoring, page 4 Realtime Events monitoring, page 5 Realtime Events monitoring, page 6 Realtime Events monitoring, page 7 Realtime Events monitoring, page 8 Realtime Events monitoring, page 9 Realtime Events monitoring, page 10 Realtime Events monitoring, page 11 Realtime Events monitoring, page 12 Realtime Events monitoring, page 13 Realtime Events monitoring, page 14 Realtime Events monitoring, page 15 Realtime Events monitoring, page 16 Realtime Events monitoring, page 17 Realtime Events monitoring, page 18 Realtime Events monitoring, page 19 Realtime Events monitoring, page 20 Realtime Events monitoring, page 21 Realtime Events monitoring, page 22 Realtime Events monitoring, page 23 Realtime Events monitoring, page 24 Realtime Events monitoring, page 25 Realtime Events monitoring, page 26 Realtime Events monitoring, page 27 Realtime Events monitoring, page 28