Join a team that delivers end-to-end technology and lifecycle management for enterprise data platforms operating both on-premises and in the AWS cloud. As a Software Engineering Advisor on the Data & Analytics Engineering (D&AE) Operational Effectiveness team, you will play a critical role in strengthening the reliability, scalability, and performance of our data platforms while helping the organization responsibly adopt GenAI-enabled data solutions.
In this role, you will partner closely with architects, analysts, platform, and security teams to design and operate modern data pipelines on AWS and Databricks , ensuring trusted, high-quality data is available to power analytics and business decision-making.
Key Responsibilities
Design, build, and maintain resilient ETL and ELT pipelines that integrate data from diverse sources into Databricks on AWS, supporting both batch and streaming workloads.
Develop and operate Databricks notebooks and workflows , including scheduling, retries, alerting, and failure recovery to ensure operational stability.
Implement and optimize Delta Lake tables , applying schema evolution, partitioning, Z-Ordering, OPTIMIZE, and VACUUM to improve performance and reliability.
Tune Databricks clusters and Spark configurations , leveraging autoscaling, instance selection, and runtime optimization while enforcing cluster policies to balance cost, performance, and availability.
Manage data governance and access controls using Unity Catalog , secrets management, and credential passthrough where applicable.
Design and implement GenAI-enabled data solutions (e.g., retrieval-augmented generation), including curating trusted datasets, generating embeddings, and integrating vector search with enterprise data platforms.
Establish GenAI governance and operational practices , including prompt and version management, evaluation metrics, monitoring, and guardrails for privacy, security, and hallucination risk.
Optimize complex queries, data models, and ingestion strategies to support large-scale analytics and high-performance workloads.
Collaborate with data architects, analysts, and data stewards to define data requirements and ensure accuracy, availability, and trustworthiness of enterprise data assets.
Monitor, troubleshoot, and resolve pipeline issues related to data quality, performance, and job failures, driving continuous improvement.
Develop data validation and quality checks to strengthen confidence in analytics and downstream reporting.
Document technical designs, workflows, and operational standards to support knowledge sharing and long-term maintainability.
Support capacity planning and partner with platform and security teams to meet performance, reliability, and security expectations.
Contribute in an agile environment, providing alternative solutions and technical guidance to support timely delivery.
Required Qualifications
8+ years of experience in a software engineering or data engineering role.
6+ years of hands-on experience with Databricks Lakehouse , including Delta Lake fundamentals and performance optimization.
Strong proficiency in Spark SQL / Databricks SQL , with a solid understanding of query execution and optimization techniques.
Experience building and operating data platforms on AWS , including services such as S3, Glue, Lambda, Airflow, and EC2.
Proficiency with Python for data engineering and pipeline development in Databricks.
Hands-on experience implementing GenAI patterns for analytics , including RAG, prompt engineering, embeddings, and vector search.
Experience operationalizing GenAI solutions, including evaluation, monitoring, data privacy, security, and foundational LLMOps/MLOps practices.
Strong understanding of data warehousing concepts and large-scale ETL performance optimization.
Experience with CI/CD practices and tools such as GitHub and Jenkins.
Excellent problem-solving skills, attention to detail, and the ability to collaborate effectively across teams.
Preferred Qualifications
Bachelor's degree in a related field.
Experience supporting enterprise-scale data platforms with strict reliability, governance, and compliance requirements.
Familiarity with cost optimization strategies for cloud-based data platforms.
If you will be working at home occasionally or permanently, the internet connection must be obtained through a cable broadband or fiber optic internet service provider with speeds of at least 10Mbps download/5Mbps upload.
For this position, we anticipate offering an annual salary of 111,700 - 186,100 USD / yearly, depending on relevant factors, including experience and geographic location.
This role is also anticipated to be eligible to participate in an annual bonus plan.
At The Cigna Group, you'll enjoy a comprehensive range of benefits, with a focus on supporting your whole health. Starting on day one of your employment, you'll be offered several health-related benefits including medical, vision, dental, and well-being and behavioral health programs. We also offer 401(k), company paid life insurance, tuition reimbursement, a minimum of 18 days of paid time off per year and paid holidays. For more details on our employee benefits programs, click here (https://jobs.thecignagroup.com/us/en/benefits) .
About The Cigna Group
Doing something meaningful starts with a simple decision, a commitment to changing lives. At The Cigna Group, we're dedicated to improving the health and vitality of those we serve. Through our divisions Cigna Healthcare and Evernorth Health Services, we are committed to enhancing the lives of our clients, customers and patients. Join us in driving growth and improving lives.
Qualified applicants will be considered without regard to race, color, age, disability, sex, childbirth (including pregnancy) or related medical conditions including but not limited to lactation, sexual orientation, gender identity or expression, veteran or military status, religion, national origin, ancestry, marital or familial status, genetic information, status with regard to public assistance, citizenship status or any other characteristic protected by applicable equal employment opportunity laws.
If you need a reasonable accommodation to complete the online application process, please email seeyourself@thecignagroup.com for assistance. Please note that this email inbox is dedicated to accommodation requests only and cannot provide application updates or accept resumes.
The Cigna Group has a tobacco-free policy and reserves the right not to hire tobacco/nicotine users in states where that is legally permissible. Candidates in such states who use tobacco/nicotine will not be considered for employment unless they enter a qualifying smoking cessation program prior to the start of their employment. These states include: Alabama, Alaska, Arizona, Arkansas, Delaware, Florida, Georgia, Hawaii, Idaho, Iowa, Kansas, Maryland, Massachusetts, Michigan, Nebraska, Ohio, Pennsylvania, Texas, Utah, Vermont, and Washington State.
Qualified applicants with criminal histories will be considered for employment in a manner consistent with all federal, state and local ordinances.
