--- title: Big Data Solutions Emerge description: Big Data Solutions Emerge --- ![websites-group](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/new-MMG-01.svg) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-new-marketsmedia-logo.svg)](https://www.marketsmedia.com/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-menu-traders-redlogo.svg)](https://www.tradersmagazine.com/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-menu-bestexe-logo.svg)](https://www.bestexecution.net/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-menu-fidesk-logo.svg)](https://www.fixglobal.com/) [![](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/dropdown-fixglobal-new-logo.svg)](https://www.fixglobal.com/) - [*Facebook*](https://www.facebook.com/MarketsMedia/) - [*Twitter*](https://twitter.com/marketsmedia) - [*Linkedin*](https://www.linkedin.com/company/markets-media-llc) - [Newsletter](https://articles.marketsmedia.com/big-data-solutions-emerge#popup-newsletter) #### Want the latest news on securities markets -- FREE? Sign up to receive exclusive articles on topics including: - Equity market structure - Profiles of buy-side investment firms - The evolution of multi-asset-class trading - Regulation and its implications for markets - The search for liquidity in fixed income markets - The convergence of fintech and capital markets Select one or more newsletters you would like to receive: menu [![Markerts media](https://articles.marketsmedia.com/hubfs/raw_assets/public/MarketsMedia_August2021/images/header%20logo.svg "Markerts media")](https://articles.marketsmedia.com/) - [Data Management](https://articles.marketsmedia.com/tag/data-management) - Data Management - Big Data Solutions Emerge Search - [Home](https://articles.marketsmedia.com/) - [Trending](https://articles.marketsmedia.com/tag/trending) - [Featured](https://articles.marketsmedia.com/tag/daily-email-feature) - [Sectors](https://articles.marketsmedia.com/tag/sectors) - [From The Markets](https://articles.marketsmedia.com/tag/from-the-markets) - [AWARDS](https://articles.marketsmedia.com/tag/events) - [Newsletter](https://awards.marketsmedia.com/newsletter-sign-up) - [Newsletter](https://articles.marketsmedia.com/big-data-solutions-emerge#popup-newsletter) Hide search Search - NewsLetter ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/trading-up-occ-iex-select-board-members-citadel-lands-lieblich-573x379-Jul-07-2022-09-34-11-57-AM.jpg) [ON THE MOVE: Citi Hires Artie Ambrose;...](https://articles.marketsmedia.com/on-the-move-citi-hires-artie-ambrose-natalie-a-brown-to-mesirow) ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/Depositphotos_445735906_L.jpg) [Trading Adapts to ESG and Sustainable...](https://articles.marketsmedia.com/trading-adapts-to-esg-and-sustainable-investing) ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/iStock-917493152-Jul-07-2022-09-34-19-09-AM.jpg) [Focus on FX Execution Connectivity](https://articles.marketsmedia.com/focus-on-fx-execution-connectivity) ![](https://articles.marketsmedia.com/hubfs/Imported_Blog_Media/Depositphotos_333839538_L.jpg) [TRACE Turns 20](https://articles.marketsmedia.com/trace-turns-20) 02.16.2012 By Terry Flanagan Data Management # Big Data Solutions Emerge 02.16.2012 By Terry Flanagan [Share](https://www.facebook.com/share.php?u=https://articles.marketsmedia.com/big-data-solutions-emerge) [Tweet](https://twitter.com/intent/tweet?text=US+ETFs+Have+Record+Net+Inflows&url=https://articles.marketsmedia.com/big-data-solutions-emerge) [Share](https://www.linkedin.com/cws/share?url=https://articles.marketsmedia.com/big-data-solutions-emerge) In-memory databases and massively parallel processors are deployed. Capital markets firms are coming to grips with the challenges associated with capturing, storing and analyzing enormous volume of data in a cost-efficient manner. “We can answer most of our problems with existing data analytics, but what we find intriguing about Big Data is the cost structure of storing large amounts of historic data,” Ed Dabagian-Paul, vice president of technical architecture at Credit Suisse, said during a recent webinar. Big Data projects are being undertaken in litigation response/regulatory compliance; control over internal data and applications, risk analytics/enterprise risk management; and trading analytics/on-demand database analytics. “Capital markets institutions of all types-buy side, sell side, exchanges, regulators and service providers—are considering and in some cases implementing Big Data solutions in response to the huge volumes of data they are forced to deal with,” according to a report by A-Team Group. While Big Data solutions are still in their infancy, market practitioners are taking their promise of handling large volumes of structured and unstructured data seriously, and expect to see deployment sin the next 12 to 18 months, the report said. According to a survey of data technologists in financial institutions conducted by A-Team Group, few firms have solutions in place to handle unstructured data such as email, IMs, PDFs, audio and video, and social media. Firms are attempting to synthesize traditional database technology for structured data with emerging Big Data technologies for unstructured data, such as Hadoop. The survey found that massively parallel processors, which involve the coordinated processing of a program between multiple independent computers, each with its own operating system and memory, were cited by 31% of respondents as a potential solution. In-memory databases, which store data in main memory rather than on disk, were cited by 17% of respondents, and NoSQL, which are “shell” relational database management systems that don’t use Structured Query Language, were cited by 15% of respondents. [Share](https://www.facebook.com/share.php?u=https://articles.marketsmedia.com/big-data-solutions-emerge) [Tweet](https://twitter.com/intent/tweet?text=US+ETFs+Have+Record+Net+Inflows&url=https://articles.marketsmedia.com/big-data-solutions-emerge) [Share](https://www.linkedin.com/cws/share?url=https://articles.marketsmedia.com/big-data-solutions-emerge) ![email](https://articles.marketsmedia.com/hubfs/Markets%20Media/email.svg) ### NEWSLETTER SIGN UP And receive exclusive articles on securities markets ### Related articles 1. [![](https://articles.marketsmedia.com/hs-fs/hubfs/Imported_Blog_Media/trading-across-the-pond-Jul-07-2022-09-33-17-07-AM.png?width=376&height=250&name=trading-across-the-pond-Jul-07-2022-09-33-17-07-AM.png)](https://articles.marketsmedia.com/eu-achieves-electronic-trading-of-standardized-otc-derivatives) Regulation ## [EU Achieves Electronic Trading of Standard OTC Derivatives](https://articles.marketsmedia.com/eu-achieves-electronic-trading-of-standardized-otc-derivatives) ISDA warns on proposed changes to post-trade deferrals regime. 07.07.2022 By Shanny Basar 2. [![](https://articles.marketsmedia.com/hs-fs/hubfs/Imported_Blog_Media/iStock-522304914-Jul-07-2022-09-33-41-28-AM.jpg?width=376&height=250&name=iStock-522304914-Jul-07-2022-09-33-41-28-AM.jpg)](https://articles.marketsmedia.com/six-digital-exchange-collaborates-with-fireblocks) Fintech ## [SIX Digital Exchange Collaborates with Fireblocks](https://articles.marketsmedia.com/six-digital-exchange-collaborates-with-fireblocks) The partnership will focus on delivering an institutional custody solution for digital assets. 07.07.2022 By Shanny Basar 3. [![](https://articles.marketsmedia.com/hs-fs/hubfs/Imported_Blog_Media/Depositphotos_103566932_L-2.jpg?width=376&height=250&name=Depositphotos_103566932_L-2.jpg)](https://articles.marketsmedia.com/iosco-publishes-crypto-asset-roadmap) Regulators ## [IOSCO Publishes Crypto-Asset Roadmap](https://articles.marketsmedia.com/iosco-publishes-crypto-asset-roadmap) The IOSCO Fintech Task Force will collaborate closely with other international bodies. 07.07.2022 By Shanny Basar [![MarketsMedia](https://articles.marketsmedia.com/hubfs/MarketsMedia.svg "MarketsMedia")](http://marketsmedia.com) - [About us](https://www.marketsmedia.com/about-us) - [Careers](https://www.marketsmediagroup.com/careers) - [Contact](https://www.marketsmediagroup.com/contact) - [Advertise](https://www.marketsmediagroup.com/advertise) - [Newsletter](https://awards.marketsmedia.com/newsletter-sign-up) - [Corporate Site](https://marketsmediagroup.com) - © 2026 Markets Media Holdings LLC - - Terms & Conditions - Privacy Policy {{ standard\_footer\_includes }}