Databricks Specialist

Robert Half • Houston, TX • 1d ago

Description

We are seeking an experienced Databricks Specialist to join our data and analytics team to architect, design, and optimize data solutions using the Databricks platform. The ideal candidate will have deep expertise in data engineering practices, big data tools, and cloud technologies to enable advanced analytics, machine learning, and scalable data processing. This role is perfect for someone who thrives on managing complex data applications and driving innovation within fast-paced environments.

Key Responsibilities:

Databricks Platform Expertise: Design, develop, and implement data pipelines, ETL processes, and analytics workflows on Databricks, ensuring optimized performance and scalability.

Big Data Processing: Leverage frameworks such as Apache Spark within Databricks to efficiently process and analyze large datasets across a variety of structured, semi-structured, and unstructured formats

Data Engineering: Build and maintain robust data models, workflows, and engineering pipelines to ensure the seamless movement of data between systems

Integration & Automation: Integrate Databricks with other cloud tools and platforms, such as Azure, AWS, or Google Cloud, and automate processes using infrastructure-as-code tools like Terraform or CloudFormation.

Collaboration: Work closely with data scientists, business analysts, and IT teams to align data solutions with analytics and machine learning needs.

Data Governance: Implement and enforce data quality, security, and governance standards within Databricks projects, ensuring compliance with organizational and regulatory requirements

Optimization: Troubleshoot and optimize Spark queries and Databricks workflows for better performance and cost management in cloud environments.

Reporting and Visualization: Collaborate on building dashboards and data visualizations using connected tools like Power BI or Tableau to provide actionable insights for stakeholders.

Training & Best Practices: Act as the subject matter expert for Databricks, mentoring team members on best practices for the platform and staying updated on emerging trends

Requirements

Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.

Proven experience (3+ years) working with Databricks, Apache Spark, and big data processing.

Hands-on expertise in Python, Scala, or Java for data engineering tasks.

Experience with SQL for data manipulation and querying.

Solid understanding of cloud platforms, particularly Azure Databricks, AWS EMR, or GCP Dataproc.

Familiarity with Delta Lake, data lakes, and building scalable architecture for real-time and batch data processing.

Excellent problem-solving skills and analytical mindset.

Ability to communicate technical concepts to non-technical stakeholders in a clear and concise manner.

Preferred Qualifications:

Certifications such as Databricks Lakehouse Fundamentals or Databricks Certified Data Engineer Associate.

Experience with machine learning workflows in Databricks.

Knowledge of DevOps practices and automation tools (e.g., Docker, Kubernetes, Jenkins).

Familiarity with BI tools like Power BI, Tableau, or Looker.

Experience with advanced analytics workflows such as forecasting, clustering, or recommendation engines.

Key Competencies:

Expertise in data engineering and big data best practices

Proficiency with Databricks tools and features, from Delta Lake to Databricks Machine Learning.

Collaborative approach to problem-solving and innovation.

Strong focus on data-driven decision-making and scalability.

Technology Doesn't Change the World, People Do.®

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

Similar Jobs

.NET Software Developer (Blazor & EF Core)

Robert Half • Houston, TX • 4h ago

IT & Engineering

Description .NET Software Developer (Blazor & EF Core) - Hybrid in Houston, TX ?Design and develop web applications using Blazor and .NET Core. Implement data access using Entity Framework Core. Participate in system...

4h ago

Go to Apply

. Techno-Functional Business Analyst

Robert Half • Houston, TX • 4h ago

IT & Engineering

Description We're looking for a Techno-Functional Business Analyst to bridge the gap between business needs and technical solutions. This hybrid role is based in Houston, TX. Gather and translate business requirements in...

4h ago

Go to Apply

.NET Software Developer (Angular & React)

Robert Half • Houston, TX • 4h ago

IT & Engineering

Description We are seeking a dynamic .NET Developer with frontend experience in Angular and React to build and maintain robust web applications. The role is hybrid in Houston, TX. Key Responsibilities: Develop and mainta...

4h ago

Go to Apply

Product Owner - Information Technology

United Airlines • Houston, TX • 1d ago

IT & Engineering

Achieving our goals starts with supporting yours. Grow your career, access top-tier health and wellness benefits, build lasting connections with your team and our customers, and travel the world using our extensive route...

1d ago

Go to Apply

Project Engineer - Electrical

Audubon Companies, LLC • Houston, TX • 1d ago

IT & Engineering

Audubon is currently seeking aProject Engineerwith anElectricalbackground to join Audubon's onshore project execution team inHouston, Texas. TheProject Engineer's primary function will be to manage and oversee the techni...

1d ago

Go to Apply

Data Engineer

Robert Half • Houston, TX • 1d ago

IT & Engineering

Description We are looking for a Data Engineer with strong experience in Databricks, Azure, and Azure ML to join our data team. This is a hybrid role in Houston, TX. Design and build scalable data pipelines using Databri...

1d ago

Go to Apply

Business Analyst

Robert Half • Houston, TX • 2d ago

IT & Engineering

Description Robert Half Technology is looking for a business analyst who is deeply passionate about understanding and translating customer needs into actionable development plans. To be successful in this role, you shoul...

2d ago

Go to Apply

AZURE AI Engineer

Robert Half • Houston, TX • 2d ago

IT & Engineering

Description We are seeking a highly skilled Azure AI/ML Engineer to design, develop, and deploy machine learning models within the Microsoft Azure ecosystem. The ideal candidate will have expertise in Azure Machine Learn...

2d ago

Go to Apply

Database Developer

Robert Half • Houston, TX • 2d ago

IT & Engineering

Description Robert Half Technology is looking for an experienced database developer with a strong SQL Server background. In this role, you'll be working to design, build and develop a new server with the right database a...

2d ago

Go to Apply

Application Developer

Robert Half • Houston, TX • 2d ago

IT & Engineering

Description Robert Half Technology is looking for an application developer who actively looks to find the creative solution to a problem. To be successful in this role, you should be passionate about developing new mobil...

2d ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.