--- title: Breaking Down Big Data description: Breaking Down Big Data --- ![websites-group](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/new-MMG-01.svg) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-new-marketsmedia-logo.svg)](https://www.marketsmedia.com/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-menu-traders-redlogo.svg)](https://www.tradersmagazine.com/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-menu-bestexe-logo.svg)](https://www.bestexecution.net/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-menu-fidesk-logo.svg)](https://www.fixglobal.com/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-fixglobal-new-logo.svg)](https://www.fixglobal.com/) - [*Facebook*](https://www.facebook.com/MarketsMedia/) - [*Twitter*](https://twitter.com/marketsmedia) - [*Linkedin*](https://www.linkedin.com/company/markets-media-llc) - [Newsletter](https://articles.marketsmedia.com/breaking-down-big-data#popup-newsletter) #### Want the latest news on securities markets -- FREE? Sign up to receive exclusive articles on topics including: - Equity market structure - Profiles of buy-side investment firms - The evolution of multi-asset-class trading - Regulation and its implications for markets - The search for liquidity in fixed income markets - The convergence of fintech and capital markets Select one or more newsletters you would like to receive: menu [![Markerts media](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/header%20logo.svg "Markerts media")](https://articles.marketsmedia.com/) - [Contributors Corner](https://articles.marketsmedia.com/tag/contributors-corner) - Contributors Corner - Breaking Down Big Data Search - [Home](https://articles.marketsmedia.com/) - [Trending](https://articles.marketsmedia.com/tag/trending) - [Featured](https://articles.marketsmedia.com/tag/daily-email-feature) - [Sectors](https://articles.marketsmedia.com/tag/sectors) - [From The Markets](https://articles.marketsmedia.com/tag/from-the-markets) - [AWARDS](https://articles.marketsmedia.com/tag/events) - [Newsletter](https://awards.marketsmedia.com/newsletter-sign-up) - [Newsletter](https://articles.marketsmedia.com/breaking-down-big-data#popup-newsletter) Hide search Search - NewsLetter ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/trading-up-occ-iex-select-board-members-citadel-lands-lieblich-573x379-Jul-07-2022-09-34-11-57-AM.jpg) [ON THE MOVE: Citi Hires Artie Ambrose;...](https://articles.marketsmedia.com/on-the-move-citi-hires-artie-ambrose-natalie-a-brown-to-mesirow) ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/Depositphotos_445735906_L.jpg) [Trading Adapts to ESG and Sustainable...](https://articles.marketsmedia.com/trading-adapts-to-esg-and-sustainable-investing) ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/iStock-917493152-Jul-07-2022-09-34-19-09-AM.jpg) [Focus on FX Execution Connectivity](https://articles.marketsmedia.com/focus-on-fx-execution-connectivity) ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/Depositphotos_333839538_L.jpg) [TRACE Turns 20](https://articles.marketsmedia.com/trace-turns-20) 03.18.2015 By Terry Flanagan Contributors Corner # Breaking Down Big Data 03.18.2015 By Terry Flanagan [Share](https://www.facebook.com/share.php?u=https://articles.marketsmedia.com/breaking-down-big-data) [Tweet](https://twitter.com/intent/tweet?text=US+ETFs+Have+Record+Net+Inflows&url=https://articles.marketsmedia.com/breaking-down-big-data) [Share](https://www.linkedin.com/cws/share?url=https://articles.marketsmedia.com/breaking-down-big-data) ***By Philip Brittan, Chief Technology Officer, Financial & Risk, Thomson Reuters*** There is *a lot* of talk these days about “Big Data”.  And there seems to be a fair amount of both confusion and mystique about what it is and what it can mean.  Big Data is essentially a valuable set of practices and technologies, and is something which can help businesses on a daily basis.  But in order to derive the most benefit from it, you have to be able to understand it and be clear exactly what you mean by it. In reality, it is not actually that complex, but the term Big Data is used broadly and increasingly vaguely, which is what makes it confusing. In my view, Big Data breaks down into two fundamental parts: 1. *Technology* to efficiently process large amounts of data 2. *Analytics* to extract useful information out of those large amounts of data **Efficient Processing** The total amount of digital information in the world is increasing at a staggering exponential rate.  Not that long ago we used to think a gigabyte was a lot of data.  Now, some companies are dealing in exabytes – that’s 1,000,000,000 gigabytes. Dealing with very large amounts of data has traditionally been expensive (you need big computers) and slow (copying or analyzing large amounts of data can take a long time).  The first big aspect of Big Data is therefore a set of technologies that help make processing large amounts of data less expensive and less time consuming.  There are many technologies used for this today, but what they all have in common is the ability to handle data from thousands of servers, processing it and presenting it in usable format at high speed. ![Philip Brittan, Thomson Reuters](https://static.hsstatic.net/BlogImporterAssetsUI/ex/missing-image.png) Philip Brittan, Thomson Reuters These technologies are not only extremely fast and efficient at dealing with large amounts of data, but they can be scaled relatively inexpensively over many low cost commodity servers.  Google has literally millions of servers powering its search capabilities and other services.  When you use Google Search, you see all these technologies in action, as your search query runs against content that is spread over thousands or even a million servers, to find exactly what you are looking for.  These technologies, while seeming quite simple, are extremely powerful and flexible. **Analytics** Once you have an efficient way to store and process large amounts of data, the next challenge is to make sense of it.  It is impossible for humans to get their heads around such vast quantities of data, so we use statistical methods to find *information* buried among all that data.  These methods have been known for a fairly long time, but firms like Google, Amazon and Facebook, along with the Big Data movement overall, have brought much broader interest in them. These statistical methods, which include various kinds of pattern matching – factoring large groups into clusters – and machine learning, are what create the almost magical experiences we have today when we use Google Search, Amazon Recommendations, or Apple Siri. These methods are powerful, and are valuable even if the underlying data set is not massively large—in fact, we see them increasingly being used on smaller datasets.  The term Big Data is still often used in these cases, but “Smart Data” might be more descriptive in this context. Another aspect of the analytical half of Big Data is the use of visualization.  A picture paints a thousand words, and Big Data projects often employ creative visualization to help the human end user gain insight from a large data set.  Visualization tools are going to become more and more important in helping humans make sense of big data.  At Thomson Reuters, we are increasingly using sophisticated visualization tools to help our customers get actionable insight from data. For example, we used innovative mapping technology to provide a clear picture of the commodities supply chain, plotting weather, news, and the positions and status of key production facilities as well as the routes of ships.  Or, in response to growing interest in social media and its influence on the financial markets, we leveraged news sentiment technology to display Twitter and Stocktwits data in a charting application.  In both instances, visualization tools help users identify trends and potential signals extremely quickly amongst vast amounts of unstructured data, giving them actionable insight that would otherwise be hard to find. Technology and analytics are the foundation to understanding Big Data. As the amount of content, data and information that we are exposed to on a daily basis continues to grow exponentially, it is ever more important to be able to distinguish the signal from the noise—to make sense of all that data and turn it into information. Big Data will only continue to grow in importance as businesses find new ways to efficiently handle the increasingly large data sets we’re being faced with every day. [Share](https://www.facebook.com/share.php?u=https://articles.marketsmedia.com/breaking-down-big-data) [Tweet](https://twitter.com/intent/tweet?text=US+ETFs+Have+Record+Net+Inflows&url=https://articles.marketsmedia.com/breaking-down-big-data) [Share](https://www.linkedin.com/cws/share?url=https://articles.marketsmedia.com/breaking-down-big-data) ![email](https://articles.marketsmedia.com/hubfs/Markets%20Media/email.svg) ### NEWSLETTER SIGN UP And receive exclusive articles on securities markets ### Related articles 1. [![](https://articles.marketsmedia.com/hs-fs/hubfs/Imported_Blog_Media/Depositphotos_5387457_l-2015-May-12-2022-08-40-47-58-AM.jpg?width=376&height=250&name=Depositphotos_5387457_l-2015-May-12-2022-08-40-47-58-AM.jpg)](https://articles.marketsmedia.com/deciphering-the-size-of-the-portfolio-trading-market) Bonds ## [Deciphering the Size of the Portfolio Trading Market](https://articles.marketsmedia.com/deciphering-the-size-of-the-portfolio-trading-market) Portfolio trading growth may signal a shift towards electronification, efficiency and minimal price impact. 05.19.2021 By Markets Media 2. [![](https://articles.marketsmedia.com/hs-fs/hubfs/Imported_Blog_Media/Depositphotos_156951870_l-2015-May-12-2022-09-29-26-33-AM.jpg?width=376&height=250&name=Depositphotos_156951870_l-2015-May-12-2022-09-29-26-33-AM.jpg)](https://articles.marketsmedia.com/crypto-assets-and-security-tokens-considerations-for-institutional-asset-servicing) Contributors Corner ## [Considerations for Institutional Digital Asset Servicing](https://articles.marketsmedia.com/crypto-assets-and-security-tokens-considerations-for-institutional-asset-servicing) Regulations and disintermediation may not go hand-in-hand. 12.18.2019 By Rob Daly 3. [![](https://articles.marketsmedia.com/hs-fs/hubfs/Imported_Blog_Media/MoneySky-May-12-2022-09-19-04-70-AM.jpg?width=376&height=250&name=MoneySky-May-12-2022-09-19-04-70-AM.jpg)](https://articles.marketsmedia.com/fed-rate-increase-boosts-trading-costs) Trading ## [Fed Rate Increase Boosts Trading Costs](https://articles.marketsmedia.com/fed-rate-increase-boosts-trading-costs) The trend is unmistakably upward, Meritsoft notes. 09.28.2018 By Terry Flanagan [![MarketsMedia](https://articles.marketsmedia.com/hubfs/MarketsMedia.svg "MarketsMedia")](http://marketsmedia.com) - [About us](https://www.marketsmedia.com/about-us) - [Careers](https://www.marketsmediagroup.com/careers) - [Contact](https://www.marketsmediagroup.com/contact) - [Advertise](https://www.marketsmediagroup.com/advertise) - [Newsletter](https://awards.marketsmedia.com/newsletter-sign-up) - [Corporate Site](https://marketsmediagroup.com) - © 2026 Markets Media Holdings LLC - - Terms & Conditions - Privacy Policy {{ standard\_footer\_includes }}