Share this Job

Lead Big Data Software Engineer

Date Posted: Feb 11, 2021

Location: Cary, NC, US, 27513

Company: MetLife

Role Value Proposition

MetLife is seeking a Bigdata lead software engineer to lead and solution critical business issues, and ingesting data into MDH (Metlife Data Hub) using Bigdata technologies. The successful candidate will have opportunity to work and learn emerging bigdata platform, development, and Global COE team. This position will work close with the existing Development team to provide support in our development and production environments.  This individual will work closely with our application development teams to design, develop and implement new enhancements and database applications in MDH. The ideal candidate will be technically savvy, with excellent communication skills and possess the ability to build relationships and collaborate effectively with business and technology partners. A passion for technology with a proven track record of implementing new technology and features is a must.


Key Responsibilities: 

  • Join the emerging platform organization, which is responsible to build, and deploy customer facing solutions using Big Data technologies.
  • Bring in your expertise with developing strategic data supply chain for superior customer experience.
  • Hands on development with Spark, Hive, NoSQL, SOLR, & In-memory data processing.
  • Develop data architecture and solution designs for classic batch, speed and serving layer.
  • Improve/ reengineer existing solutions with data speed/latency, quality and ability to derive analytics insight.
  • Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities.
  • Optimize and tune queries, job flows on Hadoop environments to meet performance requirements.
  • Programming using Shell script/Python to create automation scripts.
  • Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders.
  • Responsible for developing and maintaining the operate runbooks.


Essential Business Experience and Technical Skills:


  • Advanced knowledge of the principles of computer application, including software engineering, system analysis and design, design and analysis of algorithms, digital systems, computer system architecture, data structures, computer networks, database management system, and problem solving and computer programming, among others.
  • Core hands on development skills in Bigdata ecosystem i.e. Spark Scala, SOLR, Pig, Hive, Kafka and HBase.
  • Experience with real-time data delivery, Kafka, NiFi, and Change-data-capture
  • Good understanding of release management, CI/CD
  • Work with Bigdata developers designing scalable supportable Application development.
  • Minimum bachelor’s degree in computer science is required, master’s degree preferred.
  • 7+ years of software design and development experience.


  • 4+ years of experience in deploying Hadoop components Hive, Spark, HBase, and SOLR.
  • Strong communication skills to lead interactions with business and technology leaders across the global lines of businesses.
  • Cloud experience is plus with Azure, and Google
  • Experience working in cross-functional, multi-location teams.
  • Excellent analytical and problem-solving skills.


Business Category

Big Data Platforms


Number of Openings



At MetLife, we’re leading the global transformation of an industry we’ve long defined. United in purpose, diverse in perspective, we’re dedicated to making a difference in the lives of our customers.


MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies, providing insurance, annuities, employee benefits and asset management to help its individual and institutional customers navigate their changing world. Founded in 1868, MetLife has operations in more than 40 countries and holds leading market positions in the United States, Japan, Latin America, Asia, Europe and the Middle East.


We are one of the largest institutional investors in the U.S. with $651 billion of total assets under management as of September 30, 2020. We are ranked #48 on the Fortune 500 list for 2020. In 2019, we were named to the Dow Jones Sustainability Index (DJSI) for the fourth year in a row. DJSI is a global index to track the leading sustainability-driven companies.


MetLife is committed to building a purpose-driven and inclusive culture that energizes our people. Our employees work every day to help build a more confident future for people around the world.


We want to make it simple for all interested and qualified candidates to apply for employment opportunities with MetLife.  For further information about how to request a reasonable accommodation, please click on the Disability Accommodations link below.


MetLife is a proud Equal Employment Opportunity and Affirmative Action employer dedicated to attracting, retaining, and developing a diverse and inclusive workforce. All qualified applicants will receive consideration for employment at MetLife without regards to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, age, disability, national origin, marital or domestic/civil partnership status, genetic information, citizenship status, uniformed service member or veteran status, or any other characteristic protected by law.


MetLife maintains a drug-free workplace.


Requisition #: 116088


Nearest Major Market: Raleigh