Metas Solutions

has an

"opening"

for a

talented

Senior Data Engineerbased in

Atlanta,

GA. The ideal candidate must be able to work onsite in the Atlanta metro area and someone who's proficient in Databricks workspaces and Azure infrastructure. In this position, you'll drive the next generation of our analytics products by architecting and delivering end-to-end cloud analytics solutions. In a fully cloud-native environment, you'll partner with product managers, data scientists, software engineers, machine learning (ML) engineers and business analysts to enable and support a platform that powers personalized experiences and operational efficiency. You'll leverage automated model CI/CD, containerized deployments (Docker/Kubernetes), and real-time monitoring to ensure our ML systems are reliable, secure, and scalable.

You will be responsible for the design, implementation, and maintenance of the Databricks workspaces and its associated Azure infrastructure. You will manage and optimize data and machine learning workloads, ensuring a reliable, secure, and scalable platform for business analysts, data engineering and data science teams.

Responsibilities:

Lead the administration and governance framework of the platform regarding the security posture of the enterprise and its key stakeholders

Design and implement automated solutions to streamline accounts and workspace administration

Collaborate with cross-functional teams to understand business needs and translate them into ML solutions

Mentor junior engineers and provide technical leadership in Databricks best practices and techniques

Conduct cost and performance analysis of the various computes, and data assets within the platform

Stay current with the latest advancements in Databricks SQL, Machine Learning and AI, and integrate new technologies and methods as applicable

Engage in knowledge sharing and contribute to building a strong, collaborative team environment

Qualifications:

5+ years of experience with Databricks Account and Workspace Administration, including governance, configuration, and security management

Experience with optimizing Databricks environments for cost efficiency, performance, and reliability

Experience with developing and maintaining Databricks data pipelines using Autoloader, Delta Live Tables, and Databricks Workflows

Experience with implementing MLOps solutions using MLflow 2.0/3.0, Serving Endpoints, and Model Registry in production environments

Experience with Databricks SQL tools such as Queries and AI/BI Dashboards

Experience with large datasets and distributed computing across cloud platforms (AWS, GCP, Azure), including Azure services like Entra ID, Data Factory, Key Vault, and Purview

Knowledge of Unity Catalog Governance Architecture and enterprise data security best practices

Possession of strong communication and documentation skills with the ability to clearly convey complex technical concepts to both technical and non-technical audiences

Ability to work on-site in Atlanta, Georgia

Master's degree in computer science, Computer Engineering, or related programs

Additional Qualifications:

Knowledge of Azure Cloud Networking concepts like VNET Injection

Databricks Platform Administrator Certification

Microsoft Certified: Azure Administrator Associate

Security Requirements:

Must be US Citizen and with the ability to obtain a US Government security clearance (Public Trust 5) within a reasonable period

Market competitive salary, commensurate with experience and education

Comprehensive benefits package available, Medical, Dental, Vision and Life Insurance, Paid Time Off (PTO), 401K with company match, growth, and promotion opportunities

We are an Equal Opportunity Employer/Veterans/Disabled

For more information, or to apply now, you must go to the website below. Please DO NOT email your resume to us as we only accept applications through our website.

Metas Solutions

Latest Jobs

Senior Data Engineer