Skip to Content
  • Offices

    Offices

    North & Latin America
    • Atlanta
    • Austin
    • Bogota
    • Boston
    • Buenos Aires
    • Chicago
    • Dallas
    • Denver
    • Houston
    • Los Angeles
    • Mexico City
    • Minneapolis
    • Monterrey
    • Montreal
    • New York
    • Rio de Janeiro
    • San Francisco
    • Santiago
    • São Paulo
    • Seattle
    • Silicon Valley
    • Toronto
    • Washington, DC
    Europe & Africa
    • Amsterdam
    • Athens
    • Berlin
    • Brussels
    • Copenhagen
    • Dusseldorf
    • Frankfurt
    • Helsinki
    • Istanbul
    • Johannesburg
    • Kyiv
    • Lisbon
    • London
    • Madrid
    • Milan
    • Munich
    • Oslo
    • Paris
    • Rome
    • Stockholm
    • Vienna
    • Warsaw
    • Zurich
    Middle East
    • Doha
    • Dubai
    • Riyadh
    Asia & Australia
    • Bangkok
    • Beijing
    • Bengaluru
    • Brisbane
    • Ho Chi Minh City
    • Hong Kong
    • Jakarta
    • Kuala Lumpur
    • Manila
    • Melbourne
    • Mumbai
    • New Delhi
    • Perth
    • Shanghai
    • Singapore
    • Sydney
    • Tokyo
    See all offices
  • Alumni
  • Media Center
  • Subscribe
  • Contact
  • Colombia | Español

    Select your region and language

    Global
    • Global (English)
    North & Latin America
    • Brazil (Português)
    • Argentina (Español)
    • Canada (Français)
    • Chile (Español)
    • Colombia (Español)
    Europe, Middle East, & Africa
    • France (Français)
    • DACH Region (Deutsch)
    • Italy (Italiano)
    • Spain (Español)
    • Greece (Elliniká)
    Asia & Australia
    • China (中文版)
    • Korea (한국어)
    • Japan (日本語)
  • Saved items (0)
    Saved items (0)

    You have no saved items.

    Bookmark content that interests you and it will be saved here for you to read or share later.

    Explore Bain Insights
  • Industries
    Main menu

    Industries

    • Aeroespacial y Defensa
    • Agroindustria
    • Químicos
    • Construcción e Infraestructura
    • Productos de Consumo
    • Servicios Financieros
    • Salud y Ciencias de la Vida
    • Maquinaria y Equipo Industrial
    • Medios y Entretenimiento
      Industries
      Medios y Entretenimiento
      • Media Lab
    • Metales
    • Minería
    • Petróleo y Gas
    • Papel y Empaque
    • Private Equity
      Industries
      Private Equity
      • Due Diligence
      • Exit Planning
      • Firm Strategy & Operations
      • Portfolio Value Creation
    • Sector Público y Social
    • Retail
    • Tecnología
    • Telecomunicaciones
      Industries
      Telecomunicaciones
      • Capital Expenditure
      • Telco Digital Transformation
    • Transporte
    • Viajes y Turismo
    • Servicios Públicos y Energías Renovables
  • Consulting Services
    Main menu

    Consulting Services

    • Customer Experience
    • Sustainability
    • Innovation
    • M&A
    • Operations
    • People & Organization
    • Private Equity
    • Sales & Marketing
    • Strategy
    • AI, Insights, and Solutions
    • Technology
    • Transformation
  • Digital
  • Insights
    Main menu

    Insights

    • Industry Insights
    • Services Insights
    • Bain Books
    • Webinars
    • Bain Futures
    View all Insights
    Featured topics
    • Tariff Response
    • Artificial Intelligence
    • Thriving in Uncertainty
    • Executive Conversations
    • Macro Trends
    • Private Equity Report
    • M&A Report
    • Healthcare Private Equity Report
    • Paper & Packaging Report
    • Technology Report
    • CEO Insights
    • CFO Insights
    • COO Insights
    • CIO Insights
    • CMO Insights
    View all featured topics
  • About
    Main menu

    About

    • What We Do
    • What We Believe
    • Our People & Leadership
    • Client Results
    • Awards & Recognition
    • Global Affiliations
    Further: Our global responsibility
    • Sustainability
    • Social Impact
    • World Economic Forum
    Learn more about Further
  • Carreras
    Main menu

    Carreras

    • Trabaja con Nosotros
      Carreras
      Trabaja con Nosotros
      • Find Your Place
      • Nuestras Áreas de Trabajo
      • Equipos Integrados
      • Estudiantes
      • Internships & Programs
      • Eventos de Reclutamiento
    • La Vida en Bain
      Carreras
      La Vida en Bain
      • Blog: Inside Bain
      • Historias Profesionales
      • Nuestra Gente
      • Dónde Trabajamos
      • Apoyando tu Crecimiento
      • Grupos de Afinidad
      • Beneficios
    • Impact Stories
    • Nuestro Proceso
      Carreras
      Nuestro Proceso
      • Qué Esperar
      • Entrevistas
    FIND JOBS
  • Offices
    Main menu

    Offices

    • North & Latin America
      Offices
      North & Latin America
      • Atlanta
      • Austin
      • Bogota
      • Boston
      • Buenos Aires
      • Chicago
      • Dallas
      • Denver
      • Houston
      • Los Angeles
      • Mexico City
      • Minneapolis
      • Monterrey
      • Montreal
      • New York
      • Rio de Janeiro
      • San Francisco
      • Santiago
      • São Paulo
      • Seattle
      • Silicon Valley
      • Toronto
      • Washington, DC
    • Europe & Africa
      Offices
      Europe & Africa
      • Amsterdam
      • Athens
      • Berlin
      • Brussels
      • Copenhagen
      • Dusseldorf
      • Frankfurt
      • Helsinki
      • Istanbul
      • Johannesburg
      • Kyiv
      • Lisbon
      • London
      • Madrid
      • Milan
      • Munich
      • Oslo
      • Paris
      • Rome
      • Stockholm
      • Vienna
      • Warsaw
      • Zurich
    • Middle East
      Offices
      Middle East
      • Doha
      • Dubai
      • Riyadh
    • Asia & Australia
      Offices
      Asia & Australia
      • Bangkok
      • Beijing
      • Bengaluru
      • Brisbane
      • Ho Chi Minh City
      • Hong Kong
      • Jakarta
      • Kuala Lumpur
      • Manila
      • Melbourne
      • Mumbai
      • New Delhi
      • Perth
      • Shanghai
      • Singapore
      • Sydney
      • Tokyo
    See all offices
  • Alumni
  • Media Center
  • Subscribe
  • Contact
  • Colombia | Español
    Main menu

    Select your region and language

    • Global
      Select your region and language
      Global
      • Global (English)
    • North & Latin America
      Select your region and language
      North & Latin America
      • Brazil (Português)
      • Argentina (Español)
      • Canada (Français)
      • Chile (Español)
      • Colombia (Español)
    • Europe, Middle East, & Africa
      Select your region and language
      Europe, Middle East, & Africa
      • France (Français)
      • DACH Region (Deutsch)
      • Italy (Italiano)
      • Spain (Español)
      • Greece (Elliniká)
    • Asia & Australia
      Select your region and language
      Asia & Australia
      • China (中文版)
      • Korea (한국어)
      • Japan (日本語)
  • Saved items  (0)
    Main menu
    Saved items (0)

    You have no saved items.

    Bookmark content that interests you and it will be saved here for you to read or share later.

    Explore Bain Insights
  • Industries
    • Industries

      • Aeroespacial y Defensa
      • Agroindustria
      • Químicos
      • Construcción e Infraestructura
      • Productos de Consumo
      • Servicios Financieros
      • Salud y Ciencias de la Vida
      • Maquinaria y Equipo Industrial
      • Medios y Entretenimiento
      • Metales
      • Minería
      • Petróleo y Gas
      • Papel y Empaque
      • Private Equity
      • Sector Público y Social
      • Retail
      • Tecnología
      • Telecomunicaciones
      • Transporte
      • Viajes y Turismo
      • Servicios Públicos y Energías Renovables
  • Consulting Services
    • Consulting Services

      • Customer Experience
      • Sustainability
      • Innovation
      • M&A
      • Operations
      • People & Organization
      • Private Equity
      • Sales & Marketing
      • Strategy
      • AI, Insights, and Solutions
      • Technology
      • Transformation
  • Digital
  • Insights
    • Insights

      • Industry Insights
      • Services Insights
      • Bain Books
      • Webinars
      • Bain Futures
      View all Insights
      Featured topics
      • Tariff Response
      • Artificial Intelligence
      • Thriving in Uncertainty
      • Executive Conversations
      • Macro Trends
      • Private Equity Report
      • M&A Report
      • Healthcare Private Equity Report
      • Paper & Packaging Report
      • Technology Report
      • CEO Insights
      • CFO Insights
      • COO Insights
      • CIO Insights
      • CMO Insights
      View all featured topics
  • About
    • About

      • What We Do
      • What We Believe
      • Our People & Leadership
      • Client Results
      • Awards & Recognition
      • Global Affiliations
      Further: Our global responsibility
      • Sustainability
      • Social Impact
      • World Economic Forum
      Learn more about Further
  • Carreras
    Popular Searches
    • Agile
    • Digital
    • Strategy
    Your Previous Searches
      Recently Visited Pages

      Content added to saved items

      Saved items (0)

      Removed from saved items

      Saved items (0)

      Forbes.com

      Data Mining Your Way to Better Due Diligence in Private Equity

      Data Mining Your Way to Better Due Diligence in Private Equity

      From scraping social media sites to mining e-commerce traffic, leading private equity firms are using web data to provide a competitive edge during due diligence.

      By Hugh MacArthur, Graham Elton, Daniel Haas and Suvir Varma

      • min read

      Article

      Data Mining Your Way to Better Due Diligence in Private Equity
      en

      This article originally appeared on Forbes.com.

      In the hypercompetitive auction processes now common to private equity markets, investors look to gain an edge in drawing insights and bidding with greater confidence. One emerging vein of raw material to be mined is the wealth of unstructured data available on the web. From scraping social media sites to mining e-commerce traffic, leading private equity firms are using web data to increase the speed and reliability of insights and thereby provide a competitive edge.

      These firms have incorporated such data into the due diligence phase, which allows them to develop proprietary insights faster and more comprehensively. That gives them greater confidence in the price they should pay for an asset. What was a long, mostly manual, laborious effort to learn about the strengths and flaws of a business now can happen in just days.

      Software tools today can organize and analyze customer reviews, geographic information, employee compensation, employee and organizational data, social media sentiment and other web data. By augmenting traditional research such as interviews and store visits, advanced analytics often provide answers that are more exact than traditional sampling or probability ranges.

      Once the data has been collected, traditional analytical tools such as Excel or SPSS Statistics may not be sufficient, so PE firms should explore additional tools such as Tableau. Software that both analyzes and visually displays data can quickly reveal important patterns that might take too long to produce using traditional spreadsheets and charts.

      PE firms are applying advanced analytics during due diligence on several fronts.

      Product assortment. Potential acquirers collect and analyze product assortment data to assess the relative pricing, assortment and discounting strategies of target companies in retail, consumer products and technology. In a due diligence of a women’s clothing retailer, an SKU assortment analysis revealed that the retailer provided a wide selection of items at comparatively lower prices.

      Employee costs and organization. Online data allows a due diligence team to sort employee counts by role or department, estimate personnel costs and assemble a rough organization chart. This provides a perspective on the employee mix and cost, as well as on the caliber of talent management. A profusion of spans and layers, for instance, may signal an opportunity to reduce headcount and improve how the company manages talent. Working with a PE firm on its due diligence of a sporting goods retailer, Bain & Company combined online data with store visit observations for the potential buyer. We concluded that the target firm, compared with its peers, had a higher proportion of store managers and support staff relative to store employees.

      Customer reviews. What customers write about vendors can deepen the understanding of differences among competitors in products, service or the overall experience—or among a target company’s locations. One due diligence of an amusement park company analyzed reviews on TripAdvisor to confirm primary research and understand the company’s competitive position.

      Social media postings. Data compiled from social media postings yields trends in sentiment and share of voice for a brand that people comment about on the web. In the due diligence of a European retail health provider, an analysis of online blogs, forums and news helped a PE firm confirm how familiar people were with the provider.

      E-commerce. Software firms crunch web traffic data to assess the search effectiveness, conversion rates and purchase sizes of online retailers. The analysis helps to identify the size and nature of post-acquisition sales opportunities.

      Geographic presence. Geographic analysis can show the competitive presence in individual markets and potentially underserved markets. And the geographic data might be combined with other data for more nuanced analysis. For example, the due diligence of a US industrial products distributor used core location data from the target company and competitors to reveal which postal codes merited expansion or new facilities.

      Even the best analytical tools have limitations—chiefly, they have access only to materials available on the Internet. They don’t yet replace other methods of research such as market participant interviews, customer surveys and intercepts, store visits and literature searches. For comprehensive insights, the best-informed due diligence will use web scraping to complement traditional research.

      Moreover, software tools do not replace business judgment. For example, just a few positive or negative reviews could easily skew average review ratings of smaller locations or less popular products. Likewise, in analyzing product assortment, scraping data on sale days or unusual periods such as holiday seasons will skew the results. Algorithms have not yet mastered cultural quirks that only a human can interpret.

      Hugh MacArthur, Graham Elton, Daniel Haas and Suvir Varma are leaders of Bain & Company’s Private Equity practice.

      Authors
      • Headshot of Hugh MacArthur
        Hugh MacArthur
        Partner, Boston
      • Headshot of Graham Elton
        Graham Elton
        Chairman, EMEA Private Equity, London
      • Headshot of Dan Haas
        Dan Haas
        Partner, Washington, DC
      • Headshot of Suvir Varma
        Suvir Varma
        Advisory Partner, Singapore
      Related Industries
      • Private Equity
      Private Equity
      Global Private Equity Report 2017

      Bain's annual Global Private Equity Report highlights how leading PE firms have begun adapting to a demanding environment.

      Read more
      Private Equity
      Bain & Company's Global Private Equity Report 2016

      Bain's annual Global Private Equity Report offers a comprehensive view of the challenges that private equity investors face following a decade of volatility and change, as well as what it will take to succeed in 2016.

      Read more
      Private Equity
      Dry Powder: Live from NEXUS 2026

      Jennifer Choi, CEO of ILPA, joins us for a wide-ranging conversation on the current mood among LPs, the mainstreaming of continuation vehicles, and the accelerating race to retail capital.

      Read more
      Private Equity
      Bain & Company’s Global Private Equity Report 2026: Executive Summary

      A glance at the top-line numbers would suggest the industry is gaining traction, but is it?

      Read more
      Private Equity
      Welcome to a New Era in Private Equity

      If you’re waiting for everything to get back to “normal,” don’t hold your breath.

      Read more
      First published in abril 2017
      Tags
      • Private Equity

      How We've Helped Clients

      Smart Pricing Helped a Private Equity Firm Unlock More Value

      See more related case studies

      Helping a Healthcare Company Unlock Maximum Value

      See more related case studies

      A Paper Company Takes Bold Steps to Make Sustainability a Source of Profits

      See more related case studies

      Want to continue the conversation

      We help global leaders with their organization's most critical issues and opportunities. Together, we create enduring change and results

      Bain Insights. Our perspectives on critical issues global businesses face in today's challenging environment, delivered monthly.

      *I have read and understand Bain’s Privacy Notice.

      Please read and agree to the Privacy Policy.
      Bain & Company
      Contact us Sustainability Accessibility Terms of use Privacy Modern Slavery Act Statement Cookie Policy Sitemap Log In

      © 1996-2026 Bain & Company, Inc.

      Contact Bain

      How can we help you?

      • Business inquiry
      • Career information
      • Press relations
      • Partnership request
      • Speaker request
      See all offices