Skip to Content
  • Offices

    Offices

    North & Latin America
    • Atlanta
    • Austin
    • Bogota
    • Boston
    • Buenos Aires
    • Chicago
    • Dallas
    • Denver
    • Houston
    • Los Angeles
    • Mexico City
    • Minneapolis
    • Monterrey
    • Montreal
    • New York
    • Rio de Janeiro
    • San Francisco
    • Santiago
    • São Paulo
    • Seattle
    • Silicon Valley
    • Toronto
    • Washington, DC
    Europe & Africa
    • Amsterdam
    • Athens
    • Berlin
    • Brussels
    • Copenhagen
    • Dusseldorf
    • Frankfurt
    • Helsinki
    • Istanbul
    • Johannesburg
    • Kyiv
    • Lisbon
    • London
    • Madrid
    • Milan
    • Munich
    • Oslo
    • Paris
    • Rome
    • Stockholm
    • Vienna
    • Warsaw
    • Zurich
    Middle East
    • Doha
    • Dubai
    • Riyadh
    Asia & Australia
    • Bangkok
    • Beijing
    • Bengaluru
    • Brisbane
    • Ho Chi Minh City
    • Hong Kong
    • Jakarta
    • Kuala Lumpur
    • Manila
    • Melbourne
    • Mumbai
    • New Delhi
    • Perth
    • Seoul
    • Shanghai
    • Singapore
    • Sydney
    • Tokyo
    See all offices
  • Alumni
  • Media Center
  • Subscribe
  • Contact
  • Global | English

    Select your region and language

    Global
    • Global (English)
    North & Latin America
    • Brazil (Português)
    • Argentina (Español)
    • Canada (Français)
    • Chile (Español)
    • Colombia (Español)
    Europe, Middle East, & Africa
    • France (Français)
    • DACH Region (Deutsch)
    • Italy (Italiano)
    • Spain (Español)
    • Greece (Elliniká)
    Asia & Australia
    • China (中文版)
    • Korea (한국어)
    • Japan (日本語)
  • Saved items (0)
    Saved items (0)

    You have no saved items.

    Bookmark content that interests you and it will be saved here for you to read or share later.

    Explore Bain Insights
  • Industries
    Main menu

    Industries

    • Aerospace & Defense
    • Agribusiness
    • Chemicals
    • Construction & Infrastructure
    • Consumer Products
    • Financial Services
    • Healthcare & Life Sciences
    • Industrial Machinery & Equipment
    • Media & Entertainment
      Industries
      Media & Entertainment
      • Media Lab
    • Metals
    • Mining
    • Oil & Gas
    • Paper & Packaging
    • Private Equity
      Industries
      Private Equity
      • Due Diligence
      • Exit Planning
      • Firm Strategy & Operations
      • Portfolio Value Creation
    • Social Impact
    • Retail
    • Technology
    • Telecommunications
      Industries
      Telecommunications
      • Capital Expenditure
      • Telco Digital Transformation
    • Transportation
    • Travel & Leisure
    • Utilities & Renewables
  • Consulting Services
    Main menu

    Consulting Services

    • Customer Experience
    • Sustainability
    • Innovation
    • M&A
    • Operations
    • People & Organization
    • Private Equity
    • Sales & Marketing
    • Strategy
    • AI, Insights, and Solutions
    • Technology
    • Transformation
  • Digital
  • Insights
    Main menu

    Insights

    • Industry Insights
    • Services Insights
    • Bain Books
    • Webinars
    • Bain Futures
    View all Insights
    Featured topics
    • Tariff Response
    • Artificial Intelligence
    • Thriving in Uncertainty
    • Executive Conversations
    • Macro Trends
    • Private Equity Report
    • M&A Report
    • Healthcare Private Equity Report
    • Paper & Packaging Report
    • Technology Report
    • CEO Insights
    • CFO Insights
    • COO Insights
    • CIO Insights
    • CMO Insights
    View all featured topics
  • About
    Main menu

    About

    • What We Do
    • What We Believe
    • Our People & Leadership
    • Client Results
    • Awards & Recognition
    • Global Affiliations
    Further: Our global responsibility
    • Sustainability
    • Social Impact
    • World Economic Forum
    Learn more about Further
  • Careers
    Main menu

    Careers

    • Work with Us
      Careers
      Work with Us
      • Find Your Place
      • Our Work Areas
      • Integrated Teams
      • Students
      • Internships & Programs
      • Recruiting Events
    • Life at Bain
      Careers
      Life at Bain
      • Blog: Inside Bain
      • Career Stories
      • Our People
      • Where We Work
      • Supporting Your Growth
      • Affinity Groups
      • Benefits
    • Impact Stories
    • Hiring Process
      Careers
      Hiring Process
      • What to Expect
      • Interviewing
    FIND JOBS
  • Offices
    Main menu

    Offices

    • North & Latin America
      Offices
      North & Latin America
      • Atlanta
      • Austin
      • Bogota
      • Boston
      • Buenos Aires
      • Chicago
      • Dallas
      • Denver
      • Houston
      • Los Angeles
      • Mexico City
      • Minneapolis
      • Monterrey
      • Montreal
      • New York
      • Rio de Janeiro
      • San Francisco
      • Santiago
      • São Paulo
      • Seattle
      • Silicon Valley
      • Toronto
      • Washington, DC
    • Europe & Africa
      Offices
      Europe & Africa
      • Amsterdam
      • Athens
      • Berlin
      • Brussels
      • Copenhagen
      • Dusseldorf
      • Frankfurt
      • Helsinki
      • Istanbul
      • Johannesburg
      • Kyiv
      • Lisbon
      • London
      • Madrid
      • Milan
      • Munich
      • Oslo
      • Paris
      • Rome
      • Stockholm
      • Vienna
      • Warsaw
      • Zurich
    • Middle East
      Offices
      Middle East
      • Doha
      • Dubai
      • Riyadh
    • Asia & Australia
      Offices
      Asia & Australia
      • Bangkok
      • Beijing
      • Bengaluru
      • Brisbane
      • Ho Chi Minh City
      • Hong Kong
      • Jakarta
      • Kuala Lumpur
      • Manila
      • Melbourne
      • Mumbai
      • New Delhi
      • Perth
      • Seoul
      • Shanghai
      • Singapore
      • Sydney
      • Tokyo
    See all offices
  • Alumni
  • Media Center
  • Subscribe
  • Contact
  • Global | English
    Main menu

    Select your region and language

    • Global
      Select your region and language
      Global
      • Global (English)
    • North & Latin America
      Select your region and language
      North & Latin America
      • Brazil (Português)
      • Argentina (Español)
      • Canada (Français)
      • Chile (Español)
      • Colombia (Español)
    • Europe, Middle East, & Africa
      Select your region and language
      Europe, Middle East, & Africa
      • France (Français)
      • DACH Region (Deutsch)
      • Italy (Italiano)
      • Spain (Español)
      • Greece (Elliniká)
    • Asia & Australia
      Select your region and language
      Asia & Australia
      • China (中文版)
      • Korea (한국어)
      • Japan (日本語)
  • Saved items  (0)
    Main menu
    Saved items (0)

    You have no saved items.

    Bookmark content that interests you and it will be saved here for you to read or share later.

    Explore Bain Insights
  • Industries
    • Industries

      • Aerospace & Defense
      • Agribusiness
      • Chemicals
      • Construction & Infrastructure
      • Consumer Products
      • Financial Services
      • Healthcare & Life Sciences
      • Industrial Machinery & Equipment
      • Media & Entertainment
      • Metals
      • Mining
      • Oil & Gas
      • Paper & Packaging
      • Private Equity
      • Social Impact
      • Retail
      • Technology
      • Telecommunications
      • Transportation
      • Travel & Leisure
      • Utilities & Renewables
  • Consulting Services
    • Consulting Services

      • Customer Experience
      • Sustainability
      • Innovation
      • M&A
      • Operations
      • People & Organization
      • Private Equity
      • Sales & Marketing
      • Strategy
      • AI, Insights, and Solutions
      • Technology
      • Transformation
  • Digital
  • Insights
    • Insights

      • Industry Insights
      • Services Insights
      • Bain Books
      • Webinars
      • Bain Futures
      View all Insights
      Featured topics
      • Tariff Response
      • Artificial Intelligence
      • Thriving in Uncertainty
      • Executive Conversations
      • Macro Trends
      • Private Equity Report
      • M&A Report
      • Healthcare Private Equity Report
      • Paper & Packaging Report
      • Technology Report
      • CEO Insights
      • CFO Insights
      • COO Insights
      • CIO Insights
      • CMO Insights
      View all featured topics
  • About
    • About

      • What We Do
      • What We Believe
      • Our People & Leadership
      • Client Results
      • Awards & Recognition
      • Global Affiliations
      Further: Our global responsibility
      • Sustainability
      • Social Impact
      • World Economic Forum
      Learn more about Further
  • Careers
    Popular Searches
    • Agile
    • Digital
    • Strategy
    Your Previous Searches
      Recently Visited Pages

      Content added to saved items

      Saved items (0)

      Removed from saved items

      Saved items (0)

      Forbes.com

      Data Mining Your Way to Better Due Diligence in Private Equity

      Data Mining Your Way to Better Due Diligence in Private Equity

      From scraping social media sites to mining e-commerce traffic, leading private equity firms are using web data to provide a competitive edge during due diligence.

      By Hugh MacArthur, Graham Elton, Daniel Haas and Suvir Varma

      • min read

      Article

      Data Mining Your Way to Better Due Diligence in Private Equity
      en

      This article originally appeared on Forbes.com.

      In the hypercompetitive auction processes now common to private equity markets, investors look to gain an edge in drawing insights and bidding with greater confidence. One emerging vein of raw material to be mined is the wealth of unstructured data available on the web. From scraping social media sites to mining e-commerce traffic, leading private equity firms are using web data to increase the speed and reliability of insights and thereby provide a competitive edge.

      These firms have incorporated such data into the due diligence phase, which allows them to develop proprietary insights faster and more comprehensively. That gives them greater confidence in the price they should pay for an asset. What was a long, mostly manual, laborious effort to learn about the strengths and flaws of a business now can happen in just days.

      Software tools today can organize and analyze customer reviews, geographic information, employee compensation, employee and organizational data, social media sentiment and other web data. By augmenting traditional research such as interviews and store visits, advanced analytics often provide answers that are more exact than traditional sampling or probability ranges.

      Once the data has been collected, traditional analytical tools such as Excel or SPSS Statistics may not be sufficient, so PE firms should explore additional tools such as Tableau. Software that both analyzes and visually displays data can quickly reveal important patterns that might take too long to produce using traditional spreadsheets and charts.

      PE firms are applying advanced analytics during due diligence on several fronts.

      Product assortment. Potential acquirers collect and analyze product assortment data to assess the relative pricing, assortment and discounting strategies of target companies in retail, consumer products and technology. In a due diligence of a women’s clothing retailer, an SKU assortment analysis revealed that the retailer provided a wide selection of items at comparatively lower prices.

      Employee costs and organization. Online data allows a due diligence team to sort employee counts by role or department, estimate personnel costs and assemble a rough organization chart. This provides a perspective on the employee mix and cost, as well as on the caliber of talent management. A profusion of spans and layers, for instance, may signal an opportunity to reduce headcount and improve how the company manages talent. Working with a PE firm on its due diligence of a sporting goods retailer, Bain & Company combined online data with store visit observations for the potential buyer. We concluded that the target firm, compared with its peers, had a higher proportion of store managers and support staff relative to store employees.

      Customer reviews. What customers write about vendors can deepen the understanding of differences among competitors in products, service or the overall experience—or among a target company’s locations. One due diligence of an amusement park company analyzed reviews on TripAdvisor to confirm primary research and understand the company’s competitive position.

      Social media postings. Data compiled from social media postings yields trends in sentiment and share of voice for a brand that people comment about on the web. In the due diligence of a European retail health provider, an analysis of online blogs, forums and news helped a PE firm confirm how familiar people were with the provider.

      E-commerce. Software firms crunch web traffic data to assess the search effectiveness, conversion rates and purchase sizes of online retailers. The analysis helps to identify the size and nature of post-acquisition sales opportunities.

      Geographic presence. Geographic analysis can show the competitive presence in individual markets and potentially underserved markets. And the geographic data might be combined with other data for more nuanced analysis. For example, the due diligence of a US industrial products distributor used core location data from the target company and competitors to reveal which postal codes merited expansion or new facilities.

      Even the best analytical tools have limitations—chiefly, they have access only to materials available on the Internet. They don’t yet replace other methods of research such as market participant interviews, customer surveys and intercepts, store visits and literature searches. For comprehensive insights, the best-informed due diligence will use web scraping to complement traditional research.

      Moreover, software tools do not replace business judgment. For example, just a few positive or negative reviews could easily skew average review ratings of smaller locations or less popular products. Likewise, in analyzing product assortment, scraping data on sale days or unusual periods such as holiday seasons will skew the results. Algorithms have not yet mastered cultural quirks that only a human can interpret.

      Hugh MacArthur, Graham Elton, Daniel Haas and Suvir Varma are leaders of Bain & Company’s Private Equity practice.

      Authors
      • Headshot of Hugh MacArthur
        Hugh MacArthur
        Partner, Boston
      • Headshot of Graham Elton
        Graham Elton
        Chairman, EMEA Private Equity, London
      • Headshot of Dan Haas
        Dan Haas
        Partner, Washington, DC
      • Headshot of Suvir Varma
        Suvir Varma
        Advisory Partner, Singapore
      Contact us
      Related Industries
      • Private Equity
      Private Equity
      Global Private Equity Report 2017

      Bain's annual Global Private Equity Report highlights how leading PE firms have begun adapting to a demanding environment.

      Read More
      Private Equity
      Bain & Company's Global Private Equity Report 2016

      Bain's annual Global Private Equity Report offers a comprehensive view of the challenges that private equity investors face following a decade of volatility and change, as well as what it will take to succeed in 2016.

      Read More
      Private Equity
      Bain & Company’s Global Private Equity Report 2026: Executive Summary

      A glance at the top-line numbers would suggest the industry is gaining traction, but is it?

      Read More
      Private Equity
      Welcome to a New Era in Private Equity

      If you’re waiting for everything to get back to “normal,” don’t hold your breath.

      Read More
      Private Equity
      Private Equity Outlook 2026: Gaining Traction

      Deal and exit value surged reassuringly in 2025 in a narrow recovery powered by megadeals.

      Read More
      Published in April 2017
      Tags
      • Private Equity

      How We've Helped Clients

      Smart Pricing Helped a Private Equity Firm Unlock More Value

      Read case study

      Mergers and Acquisitions Helping a Healthcare Company Unlock Maximum Value

      Read case study

      Sustainability A Paper Company Takes Bold Steps to Make Sustainability a Source of Profits

      Read case study

      Ready to talk?

      We work with ambitious leaders who want to define the future, not hide from it. Together, we achieve extraordinary outcomes.

      Selected for you

      Global Private Equity Report 2026

      Powering forward in a new era: Our annual report examines key trends shaping the dealmaking landscape.

      For you

      Stay ahead in a rapidly changing world. Subscribe to Bain Insights, our monthly look at the critical issues facing global businesses.

      *I have read and understand Bain’s Privacy Notice.

      Please read and agree to the Privacy Policy.
      Bain & Company
      Contact us Sustainability Accessibility Terms of use Privacy Modern Slavery Act Statement Cookie Policy Sitemap Log In

      © 1996-2026 Bain & Company, Inc.

      Contact Bain

      How can we help you?

      • Business inquiry
      • Career information
      • Press relations
      • Partnership request
      • Speaker request
      See all offices