Practical analysis for investment professionals
22 October 2019

What Can AI and Big Data Do for Finance?

Larry Cao, CFA, is the author of AI Pioneers in Investment Management from CFA Institute.


AlphaGo brought artificial intelligence (AI) out of computer labs and into the living room.

From October 2015, when the AlphaGo AI first beat a professional human competitor, to January 2018, several months after it defeated Ke Jie, the top-ranked player in the world, AI’s popularity had tripled as measured by Google Trends.

Investment professionals have watched all this from the sidelines with a mixture of excitement and anxiety: Will AI beat humans in investing too?

The AI Pioneers in Investment Management report from CFA Institute addresses this issue in detail by examining the trends and use cases of AI and big data in investments around the world.

Let me break down some of the report’s major revelations.

Subscribe Button

What can AI and big data do?

AI and big data are enabling technologies. Together they help us accomplish two things:

  1. Process new data that we did not have access to or couldn’t process before.
  2. Process data in ways that we weren’t able to before.

Thanks to advances in natural language processing (NLP), computer vision, and voice recognition, we can now sort and analyze more and more text, imagery, and spoken language through automation. AI programs in these areas have already outperformed the average human.

So what can we extrapolate from these developments? That many repetitive and rudimentary tasks — transcription, for example — will increasingly be handled by AI programs.

Big data’s popularity is very much a function of these advances and their expected evolution. AI programs target what’s called unstructured data — social media postings, depersonalized credit card transactions, and satellite imagery, for example — that mainstream analysts rarely used before. This new, alternative data forms much of the new frontier in investment management.

By harnessing advances in machine learning and deep learning, we can find new and more accurate relationships from this data. Much of today’s data analysis still relies on linear programming techniques that place constraints on the variables and their assumed relationships. Machine learning and deep learning have the potential to remove these barriers in many cases.

AI Pioneers in Investment Management

What can AI and big data do in investing?

AI and big data represent the future of investing. Their broad application is likely to usher in perhaps the most significant change in the history of the industry. Why? Because with AI and big data:

  • Analysts will be able to perform more thorough analysis.
  • Portfolio managers will make better informed decisions.

We now not only have access to more and different varieties of information, but also more timely — even real-time — information. Put another way, as analysts we no longer have to go the extra mile to turn over a rock. We can apply satellite data and look under many unturned rocks much more quickly.  

For example, in the old days, if we wanted to independently verify a store’s performance, we might sit in the parking lot and monitor car and foot traffic. In some ways, that approach went too far. In others, it didn’t go far enough. After all, we can only sit in so many parking lots. But big data gives us efficient ways to maximize firsthand data. Rather than staking out car parks, we can buy satellite imagery of lots of store parking lots — indeed, as many as we can afford.

While Tesla’s production information may not be available until its official release, we can estimate staffing levels based on publicly available cell phone data. In fact, that’s precisely what Thasos Group did. By gauging the number of cell phones present near Tesla’s plant, they independently verified that Tesla was running around the clock with three full shifts.

Elsewhere, analysts at Goldman Sachs overlaid publicly available labor information on top of the geometric data of production sites to estimate the market power of manufacturers in aggregate.

Add machine learning and deep learning to big data, and we can now crunch the data in countless new ways. This has vastly expanded the applications of traditional quant methods. We can feed the model input, and the model gives us an output.

Of course, we need to set the parameters properly, but the process makes it possible to capture relationships that might previously have been unknowable. On the downside, there can be a problematic black box effect: The analysis may not yield a true window into the relationships between the input and the output.

How should investment professionals respond?   

Having read all that, should we now go freshen up our computer programming skills?

It would be commendable. But we’re probably better off prioritizing two things:

  • Taking our investment skills up a notch.
  • Developing a sufficiently broad knowledge base to work well with colleagues/collaborators in technology.

Why? Because the successful investment professionals and teams of the future will be strong in both artificial intelligence and human intelligence. These teams will have both an investment and technology function as well as an innovation function.

The world is getting increasingly complex and specialized. The days of multi-talented operators who do everything on their own are largely over. The expectation for future investment professionals is that they will need T-shaped skills — specialized investment knowledge along with enough technology and “soft” skills to work with the data scientists on their teams. Tech professionals on the investment team will also need to know about investing.

Of course, if you’re the rare talent with sophisticated knowledge of both investments and technology, more power to you. Just remember that you’ll need to spend twice as much effort recharging yourself with continuous professional development.

The main takeaway is clear: AI will transform investment management, but it is not the mass extinction event for human investment managers that many fear. Rather, those investment teams that successfully adapt to the evolving landscape will persevere. Those that don’t will render themselves obsolete.

The future is here. And it is in our hands.

For more insights on artificial intelligence, check out AI Pioneers in Investment Management.

If you liked this post, don’t forget to subscribe to the Enterprising Investor.


All posts are the opinion of the author. As such, they should not be construed as investment advice, nor do the opinions expressed necessarily reflect the views of CFA Institute or the author’s employer.

Image credit: ©Getty Images/nevarpp


Professional Learning for CFA Institute Members

CFA Institute members are empowered to self-determine and self-report professional learning (PL) credits earned, including content on Enterprising Investor. Members can record credits easily using their online PL tracker.

About the Author(s)
Larry Cao, CFA

Larry Cao, CFA, senior director of industry research, CFA Institute, conducts original research with a focus on the investment industry trends and investment expertise. His current research interests include multi-asset strategies and FinTech (including AI, big data, and blockchain). He has led the development of such popular publications as FinTech 2017: China, Asia and Beyond, FinTech 2018: The Asia Pacific Edition, Multi-Asset Strategies: The Future of Investment Management and AI Pioneers in Investment management. He is also a frequent speaker at industry conferences on these topics. During his time in Boston pursuing graduate studies at Harvard and as a visiting scholar at MIT, he also co-authored a research paper with Nobel laureate Franco Modigliani that was published in the Journal of Economic Literature by American Economic Association. Larry has more than 20 years of experience in the investment industry. Prior to joining CFA Institute, Larry worked at HSBC as senior manager for the Asia Pacific region. He started his career at the People’s Bank of China as a USD fixed-income portfolio manager. He also worked for US asset managers Munder Capital Management, managing US and international equity portfolios, and Morningstar/Ibbotson Associates, managing multi-asset investment programs for a global financial institution clientele. Larry has been interviewed by a wide range of business media, such as Bloomberg, CNN, the Financial Times, South China Morning Post and the Wall Street Journal.

1 thought on “What Can AI and Big Data Do for Finance?”

  1. Kirk Cornwell says:

    An investment manager or investor whose “indicators” have been successful over time could, I suppose, be rendered “obsolete” by refusal to incorporate AI into the mix. “Things are different now” has historically been a dangerous statement, and it is just as likely those indicators will continue to serve him.

Leave a Reply

Your email address will not be published. Required fields are marked *



By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close