Lead Data Engineer

WHAT MAKES US A GREAT PLACE TO WORK

We are proud to be consistently recognized as one of the world’s best places to work. We are currently the top ranked consulting firm on Glassdoor’s Best Places to Work list and have earned the #1 overall spot a record seven times.

Extraordinary teams are at the heart of our business strategy, but these don’t happen by chance. They require intentional focus on bringing together a broad set of backgrounds, cultures, experiences, perspectives, and skills in a supportive and inclusive work environment. We hire people with exceptional talent and create an environment in which every individual can thrive professionally and personally.

WHO YOU’LL WORK WITH

You’ll join our Engineering experts within the AI, Insights & Solutions team. This team is part of Bain’s digital capabilities practice, which includes experts in analytics, engineering, product management, and design. In this multidisciplinary environment, you'll leverage deep technical expertise with business acumen to help clients tackle their most transformative challenges. You’ll work on integrated teams alongside our general consultants and clients to develop data-driven strategies and innovative solutions. Together, we create human-centric solutions that harness the power of data and artificial intelligence to drive competitive advantage for our clients. Our collaborative and supportive work environment fosters creativity and continuous learning, enabling us to consistently deliver exceptional results. We are committed to building a diverse and inclusive team and encourage candidates of all backgrounds to apply. Bain offers comprehensive benefits and flexible policies that are designed to support you, so you can thrive personally and professionally.

WHAT YOU’LL DO

• Travel is required (30%)
• Develop data and software solutions to address large-scale enterprise challenges for Bain's clients, serving as the data engineer and expert within a cross-functional team•
• Develop and maintain long-lasting products that support internal or client needs
• Collaborate closely with and influence general consulting teams to identify analytics solutions for client business problems and to execute those solutions
• Collaborate with data engineering leaders to develop and advocate for modern data engineering concepts to both technical audiences and business stakeholders
• Enable data and technology for data science, analytics, and other application use cases via data engineering 
• Transformations at scale including cleaning, enriching, de-duping, joining and correlated on structured, semi-structured or unstructured data
• Defining and implementing new and innovative deployment techniques, tooling, and infrastructure automation within Bain the full software development life cycle including designing, writing documentation and unit/integration tests, and conducting code reviews for data engineering solutions
• Participate in infrastructure engineering for data ecosystem including development, testing, deployment and release
• Provide technical guidance to external clients and internal stakeholders in Bain
• Contribute to industry-leading innovations that translate into great impact for clients in case work
• Stay current with emerging trends and technologies in cloud computing, data analysis, and software engineering, and proactively identify opportunities to enhance the capabilities of the analytics platform"

ABOUT YOU

Kindly submit your CV/resume in English only

Technical Skills and Knowledge:

• Minimum 5 years of experience
• Proven experience in end-to-end data and software engineering within either/or product engineering or professional services organizations, including project setup, test cases, dependency, and build management

• Working knowledge of (3+ years) Python, Scala, C/C++, Java, C#, Go, or similar programming language

• Experience in deploying serverless data pipelines through containerization and terraform orchestration 
• Experience in data ingestion using one or more modern ETL compute and orchestration frameworks (Airflow, Beam, Luigy, Spark, Nifi or any other)
• Experience (3+ years) of  SQL or NoSQL databases: PostgreSQL, SQL Server, Oracle, MySQL, Redis, MongoDB, Elasticsearch, Hive, HBase, Teradata, Cassandra, Amazon Redshift, Snowflake
• Experience with Cloud platforms and services (AWS, Azure, GCP, etc.) or Kubernetes via Terraform automation, and associated deep understanding of failover, high-availability, and high scalability  
• Experience with DevOps, CI/CD, Github Actions, version control and git workflows
• Experience scaling and optimizing schema and performance turning SQL and ETL pipelines in data lake and data warehouse environments
• Strong computer science fundaments in data structures, algorithms, automated testing, object-oriented programming, performance complexity, and implications of computer architecture on software performance
• Experience working according to agile principles
• Fluency in both Japanese and English is required

Interpersonal Skills:

• Strong interpersonal and communication skills, including the ability to explain and discuss technicalities of solutions, algorithms and techniques with colleagues and clients from other disciplines
• Curiosity, proactivity and critical thinking
• Ability to collaborate with people at all levels and with multi-office/region teams

Education:

• Master’s degree in Computer Science, Engineering, or a related technical field is a plus