Share this Job

Senior Software Engineer - Spark

Date Posted: Jul 21, 2021

Location: Cary, NC, US, 27513

Company: MetLife

Role Value Proposition: 

MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights, and value to its customers. The team is the center of excellence in data engineering in MetLife and plays a key role in data enablement through multiple data stores, supporting different kind of analytical use cases to be able to derive predictive, prescriptive, and descriptive insights. The Senior software development engineer serves as big data development expert within the data analytics engineering organization of MetLife Data & Analytics. This position has the responsibility of building ETL, data warehousing and reusable components using cutting edge big data and cloud technologies. The resource will collaborate with the business systems analyst, technical leads, project managers and business/operations teams in building data enablement solutions across different LOBs and use cases.


Key Responsibilities:

  • Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes
  • Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.
  • Develop quality code with thought through performance optimizations in place right at the development stage.
  • Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.
  • Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvements.
  • Ingesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable, and maintainable ETL code
  • Interact with business analysts and functional analysts in getting the requirements and implementing the ETL solutions.


Essential Business Experience and Technical Skills:


  • 4+ years of software engineering experience
  • Bachelor’s degree required, major in related field strongly preferred
  • Building and Implementing data ingestion and curation process developed using Big data tools such as Spark (Scala/python/Java), Hive, HDFS, Sqoop ,Kafka, Kerberos, Impala  etc. and CDP 7.x
  • Strong analytic skills related to working with unstructured datasets
  • Strong experience in building/designing Data warehouses, data stores for analytics consumption On prem and Cloud (real time as well as batch use cases)
  • Solutions development and delivery experience with recent experience in data engineering.
  • Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
  • Eagerness to learn new technologies on the fly and ship to production


  • Expertise in Python and experience writing Azure functions using Python/Node.js
  • Experience using Event Hub for data integrations.
  • Proficiency and extensive Experience with Spark & Scala/Python and performance tuning
  • Hive database management and Performance tuning - Partitioning / Bucketing.
  • Hands on expertise in: Implementing analytical data stores in Azure platform using ADLS/Azure data factory /Data Bricks and Cosmos DB (mongo/graph API)
  • Experience ingesting using Azure data factory, Complex ETL using Data Bricks.


Business Category

Global Technology – Data and Analytics


Number of Openings



At MetLife, we’re leading the global transformation of an industry we’ve long defined. United in purpose, diverse in perspective, we’re dedicated to making a difference in the lives of our customers.




MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies, providing insurance, annuities, employee benefits and asset management to help its individual and institutional customers navigate their changing world. Founded in 1868, MetLife has operations in more than 40 countries and holds leading market positions in the United States, Japan, Latin America, Asia, Europe and the Middle East.


We are one of the largest institutional investors in the U.S. with $642.4 billion of total assets under management as of March 31, 2021. We are ranked #46 on the Fortune 500 list for 2021. In 2020, we were named to the Dow Jones Sustainability Index (DJSI) for the fifth year in a row. DJSI is a global index to track the leading sustainability-driven companies. We are proud to have been named to Fortune magazine's 2021 list of the "World's Most Admired Companies." 


MetLife is committed to building a purpose-driven and inclusive culture that energizes our people. Our employees work every day to help build a more confident future for people around the world.  Visit us at to learn more about our brand, history, and values. 


We want to make it simple for all interested and qualified candidates to apply for employment opportunities with MetLife.  If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to or call our Employee Relations Department at 1-877-843-3711.


MetLife is a proud Equal Employment Opportunity and Affirmative Action employer dedicated to attracting, retaining, and developing a diverse and inclusive workforce. All qualified applicants will receive consideration for employment at MetLife without regards to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, age, disability, national origin, marital or domestic/civil partnership status, genetic information, citizenship status, uniformed service member or veteran status, or any other characteristic protected by law.


MetLife maintains a drug-free workplace.


Requisition #: 118284


Nearest Major Market: Raleigh