Using Search Trends & Social Media to Predict Stock Market Moves

Just as popular search terms can reflect the news, sports and entertainment events going on in a particular country at any point in time, looking as search engine queries to predict future behaviour is not new either.

Search engine Google itself has published research through the journal Nature and on its site showing that there is a close correlation between how many people are searching for flu-related keywords, and how many people have actually developed the symptoms of flu.  Whilst not everyone who looks-up keywords relating to flu is going to have it themselves, it is likely that they’ll know someone who has developed it, or there is an outbreak in their local area.  So Google, looking at the popularity of searches and where they are clustered, can determine where flu is most prevalent in near-real time.

But Google’s Flu Trends analysis is all about modelling events that have happened in the past.  Can search terms be used to predict likely future behaviours?

The UK’s Bank of England seems to think so.  In 2011 they concluded that using search terms they could out-perform the most traditional data points used to predict the country’s economic performance.  Using Google’s Insights for Search they found that not searches for “estate agents” would increase ahead of spikes in house prices.  And now new research suggests that searches for particular stock market and finance related keywords may help to predict stock market movements.

Using data public data from Google’s Trend service, researchers analysed the search volume of 98 different keywords between 2004 and 2011 – and compared these keywords against movements in the US Dow Jones Industrial Average (DJIA).

The research showed, perhaps counter intuitively, that the volume of searches for keywords such as “stocks and “revenue” went down ahead of rises in the DJIA, and conversely searches for finance keywords went up ahead of a fall in the DJIA.

The researchers put this search behaviour down to the concept of loss aversion.  Where people are concerned about the stock market and the value of their investments they tend to gather more information about the stock market and their investment.  The research team suggested that using their strategy of buying the DJIA as search volumes fell, and then selling as volume rose would have delivered a profit of 326%between 2004 and 2011 versus simply buying at the start of the period and selling in 2011.

It’s certainly an intriguing research paper, but does it stack up?  Research elsewhere has shown that particular investments, such as Gold, go up with the amount of column inches in newspaper.  And this seems more logical – if John Doe keeps reading in newspapers that Gold is a good investment and that the price is going up, he’s more likely to buy.  And this in turn helps keep the price of gold up, which leads to further newspaper articles and more price rises. Why should the volume of search terms be any different?

Perhaps instead rather than looking at a broad spectrum of financial keywords and the rise and fall in volume, we should consider looking at particular investments – whether Gold, Oil or a particular stock or share.  And further, that we try and look at the connotations or “emotion” of keywords associated with this.  This will almost certainly give us a great insight into particular investments.  An increase in keywords for “bullish”, “positive”, “above expectations” “record growth” and so on tied to a share or investment would surely be a sign that its price is only going to rise?  And in the same way keywords for “profit warning”, “sluggish”, “bearish” and so on would seem to indicate an ever growing concern about the financial health of a particular investment.

And let’s take this a step further – having insights into how people perceive the products of a company can surely predict the future of the share price?  Lots of negative sentiment about a product will lead to lower sales, perhaps a lot of products being returned, and ultimately a fall in profits.  The share price will in turn head downwards.

With “Big Data” the ability to not only collect all this information, whether from Google Trends, Twitter, new stories or wherever, makes this new kind of modelling a reality.  We saw last week, with the hacking of Associated Press Twitter account that traders do already look to Twitter and social media for real time information to give them that extra edge.

Associated Press False Story Planted by Hackers Drives Share Prices Lower

Associated Press False Story Planted by Hackers Drives Share Prices Lower

But how long before we take out that human weakness to only be able to assimilate a few rather than millions of data points instantaneously?  Remove that gut feel that many traders say drives their trades.  With many firms already using algorithmic or “algo” “black box trading” to do high-frequency trading it’s not a big leap to see them using search terms and social media “big-data” to determine which investments to buy or sell.

James Barnes,

Share this

More from StatusCake


Microservices vs Monoliths explained

6 min read If you’re a dev you’ve no doubt, come across people talking about monolith and microservice application architecture. Perhaps you are involved in designing a new system and have been asked to consider both architectures. The conversations are often regarding how microservices are the successor to monolith architecture, but today I’m going to try and layout why it’s not as simple as one being better than the other.

black friday

Why you should have a website monitoring tool ready for Black Friday

2 min read It’s not all fun and games as a company owner during the biggest sales season of the year; unfortunately, you’re more likely to suffer website issues than on an average day. Find out how you can keep your website performing at its best during Black Friday right here!


Why Google SSO is so important

3 min read Do you know what an SSO is? Do you know if you’re currently using one? Here’s everything you need to know about an SSO and what the benefits are to using them.

affiliate marketing
How To

How to make money online for beginners

5 min read In this article, we are going to look at some of the options to help you start making money online as a beginner from home, with the flexibility and a small investment depending on the model that you want to pursue and right for you.

design patterns

3 useful design patterns every developer should know about

7 min read The term “Design Pattern” describes a well-known and battle-tested solution to a problem that developers tend to encounter again and again when developing software. Here’s our step-by-step guides to the most useful ones!


Shiny, new CSS features to get to know

4 min read The CSS landscape at the moment is ever-changing. There are many new features that have been released recently, so I thought I’d have a look around and summarise those that caught my eye, concisely in this post.

Want to know how much website downtime costs, and the impact it can have on your business?

Find out everything you need to know in our new uptime monitoring whitepaper 2021

*By providing your email address, you agree to our privacy policy and to receive marketing communications from StatusCake.