Share this Job

Lead Big Data Engineer

Date Posted: Apr 29, 2021

Location: Cary, NC, US, 27513

Company: MetLife

Role Value Proposition:

Join the emerging platform organization, which is responsible to build, and deploy customer facing solutions using Big Data technologies. Bring in your expertise with developing strategic data supply chain for superior customer experience. 


Key Responsibilities:

  • Perform hands on development with Spark, Hive, NoSQL, SOLR, Janus, Kafka & In-memory data processing. 

  • Develop data architecture and solution designs for classic batch, speed and serving layer. 

  • Improve / reengineer existing solutions with data speed/latency, quality and ability to derive analytics insight. 

  • Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities.  


Essential Business and Technical Skills:


  • Advanced knowledge of the principles of computer application, including software engineering, system analysis and design, design and analysis of algorithms, digital systems, computer system architecture, data structures, computer networks, database management system, and problem solving and computer programming, among others. 

  • Core hands on development skills in Bigdata ecosystem i.e. Spark Scala, SOLR, Hive, HBase and Janus.  

  • Experience with real-time data delivery, Kafka, NiFi, and Change-data-capture 

  • Optimize and tune queries, job flows on Hadoop environments to meet performance requirements. 

  • Good understanding of release management, CI/CD 

  • Work with Bigdata developers designing scalable supportable Application development. 

  • Programming using Shell script/Python to create automation scripts. 

  • Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders. 

  • Responsible for developing and maintaining the operate runbooks. 

  • Minimum bachelor’s degree in computer science or related field is required, master’s degree preferred. 

  • 8+ years of software design and development experience. 


  • 4+ years of experience in deploying Hadoop components Hive, Spark, HBase, SOLR and Janus.  

  • Strong communication skills to lead interactions with business and technology leaders across the global lines of businesses. 

  • Cloud experience is plus with Azure, and Google 

  • 3 to 5 years of functional experience in Insurance industry  

  • Experience working in cross-functional, multi-location teams. 

  • Excellent analytical and problem-solving skills.


Business Category

Big Data Platforms


Number of Openings



At MetLife, we’re leading the global transformation of an industry we’ve long defined. United in purpose, diverse in perspective, we’re dedicated to making a difference in the lives of our customers.


MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies, providing insurance, annuities, employee benefits and asset management to help its individual and institutional customers navigate their changing world. Founded in 1868, MetLife has operations in more than 40 countries and holds leading market positions in the United States, Japan, Latin America, Asia, Europe and the Middle East.


We are one of the largest institutional investors in the U.S. with $659.6 billion of total assets under management as of December 31, 2020. We are ranked #48 on the Fortune 500 list for 2020. In 2020, we were named to the Dow Jones Sustainability Index (DJSI) for the fifth year in a row. DJSI is a global index to track the leading sustainability-driven companies.   


MetLife is committed to building a purpose-driven and inclusive culture that energizes our people. Our employees work every day to help build a more confident future for people around the world.  Visit us at to learn more about our brand, history, and values. 


We want to make it simple for all interested and qualified candidates to apply for employment opportunities with MetLife.  If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to or call our Employee Relations Department at 1-877-843-3711.


MetLife is a proud Equal Employment Opportunity and Affirmative Action employer dedicated to attracting, retaining, and developing a diverse and inclusive workforce. All qualified applicants will receive consideration for employment at MetLife without regards to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, age, disability, national origin, marital or domestic/civil partnership status, genetic information, citizenship status, uniformed service member or veteran status, or any other characteristic protected by law.


MetLife maintains a drug-free workplace.


Requisition #: 117119


Nearest Major Market: Raleigh