Lead Cloud Data Engineer

Raymond James Financial, Inc. • Memphis, TN • 2h ago

This position will follow our hybrid work model, we expect the selected candidate to be in office 2-3 days a week(10-12 days a month ) at the following office location: St. Petersburg, FL/ Memphis, TN/ Denver, CO/Southfield, MI

Responsibilities:

Design and develop scalable ETL pipelines using AWS Glue and PySpark.

Integrate data from various sources into Amazon Redshift, ensuring data quality and consistency.

Optimize the performance of data processing jobs and Redshift queries.

Deploy infrastructure as code (IaC) with Terraform

Monitor and troubleshoot data pipelines to ensure reliability and efficiency.

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.

Ensure compliance with security policies and regulations.

Document data workflows and best practices.

Mentor and guide junior engineers on the team.

Continuously explore new AWS services and technologies to improve existing solutions.

Skills:

Expert level experience with AWS Cloud Services is preferred, knowledge of other Cloud Providers is a plus

Experience and understanding of AWS Cloud Services components like Redshift, S3, Kafka, Glue, AirFlow, SageMaker, EMR, Athena, Lake Formation, DynamoDB, Aurora, VPC, IAM and many other Cloud Service modules.

Working experience in Python is preferred, Java and other languages are a plus

Nice to have Terraform or other Infrastructure as Code experience

Knowledge and experience with Analytics, Data Warehouse and Big Data concepts across both batch and streaming patterns

Solid understanding of networking, infrastructure, cost management, SRE concepts

Creating patterns for adoption from scratch and being able to document and articulate coding and architecture standards for others to follow.

Performance tuning and optimization of code and infrastructure

Creating a culture of continuous improvement, performs code reviews and makes recommendations for improvement or streamlining patterns

Relevant experience in various database platforms, ETL solutions/products, Infrastructure, ETL architecture and On-Prem or Cloud Services.

Financial Services Industry knowledge is a plus.

Ability to:

Identify and understand issues, problems and opportunities for automation.

Good communication and organization skills that clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message.

Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints and probable consequences.

Demonstrate a satisfactory level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise.

Develop and use collaborative relationships to facilitate the accomplishment of work goals.

Make internal and external clients and their needs a primary focus of actions; develop and sustain productive client relationships.

Certifications

Preferred , not required

AWS Certified Solutions Architect AWS Certified Big Data AWS Certified Data Analytics AWS Certified Developer AWS Certified Machine Learning

Similar Jobs

Electrical Assembler

Aerotek • Memphis, TN • 8h ago

IT & Engineering

Electrical Assembler Description Will be wiring control panels from scratch. Looking for a level 1 tech that has familiarity with electrical schematics/wiring/electrical assembly style. must be able to read tape measure...

8h ago

Go to Apply

Electrical Assembler

Aerotek • Memphis, TN • 8h ago

IT & Engineering

Electrical Assembler - 1st Shift Aerotek - Hiring Now Aerotek is looking for Entry-Level Electrical Assemblers to wire and assemble control panels in a clean, climate-controlled facility. You Will: Wire control panels us...

8h ago

Go to Apply

Sr. Electrical Engineer

Hargrove Engineers & Constructors • Memphis, TN • 1d ago

IT & Engineering

Senior Electrical Engineer Greenville, SC (Primary) | Nationwide Opportunities Available Hargrove Engineers & Constructors is seeking an experienced Electrical Engineer to support complex industrial EPC projects acro...

1d ago

Go to Apply

Senior Electrical Engineer

Hargrove Engineers & Constructors • Memphis, TN • 1d ago

IT & Engineering

Hargrove is seeking Electrical Engineering talent to support our team! Locations & Work Flexibility Primary location: Mobile, AL Additional office options: TX, LA, SC, GA, PA Hybrid or interoffice execution support m...

1d ago

Go to Apply

Lead UX Designer - Enterprise Systems & Strategy

Insight Global • Collierville, TN • 1d ago

IT & Engineering

Job Description A client/employer of Insight Global is searching for a Senior UX Design Lead to help envision, shape, and evolve complex enterprise systems within a global supply chain and logistics environment. This ind...

1d ago

Go to Apply

Enterprise Data Engineer Sr.

First Horizon Bank • Memphis, TN • 1d ago

IT & Engineering

Description Location: On site at location listed in job posting Weekly Schedule: Monday-Friday, 8am-5pm Job Description The Enterprise Data Engineer position on the Enterprise Data Solutions team is part of our Corporate...

1d ago

Go to Apply

IT Compliance Specialist, SISP

Sedgwick • Southaven, MS • 3d ago

IT & Engineering

By joining Sedgwick, you'll be part of something truly meaningful. It's what our 33,000 colleagues do every day for people around the world who are facing the unexpected. We invite you to grow your career with us, experi...

3d ago

Go to Apply

IT Compliance Specialist, SISP

Sedgwick • Memphis, TN • 3d ago

IT & Engineering

3d ago

Go to Apply

Hydro Mechanical Engineer

CACI International • Memphis, TN • 4d ago

IT & Engineering

Job Title: Hydro Mechanical Engineer Job Category: Engineering Time Type: Full time Minimum Clearance Required to Start: Secret Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Local The Op...

4d ago

Go to Apply

Lead Histopathology Technologist

Veterans Affairs, Veterans Health Administration • Memphis, TN • 6d ago

IT & Engineering

Summary The incumbent serves as a Lead Histopathology Technologist within Pathology and Laboratory Medicine Service at Lt. Col. Luke Weathers Jr., VA Medical Center, Memphis, Tennessee. At this level, the lead histopatho...

6d ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.