[Google News API] Scrape sidebar topic in search results

[alexbarron]

If you search for a keyword on Google News and it matches a topic, Google News will display an option to look for other news articles matching that topic. We're currently not scraping this topic to allow our users to use the topic in token_token on subsequent searches.

A long-time customer asked us to scrape this. In the meantime, I've advised them they can copy the token from the URL on actual Google News to use in our API's topic_token field.

Clicking the topic brings you to this page:

Public links: Playground | Google News Search Results | Google News Topic Results

Internal links: Intercom

[ocvit]

Feature has been released.

Related data from the right sidebar is now parsed into related_topics and related_publications.