Data Engineering Manager

Insight Global • Fort Mill, SC • 5h ago

Job Description

Lead a team of 2-5 Data Engineers with varied experience level to design and build data pipelines from various data sources to a target data warehouse using real-time and batch data load strategies utilizing cutting edge cloud technologies.

Serve as a people leader by directly mentoring and coaching engineers, supporting formal performance review cycles, and providing regular, actionable feedback to drive individual growth and team success.

Work with a cross functional team of business stakeholders, engineering leaders, data analysts and data scientists to formulate both business and technical requirements.

Partner with business and data leaders to understand broader business strategies and define a roadmap outlining how the team will support and enable key initiatives

Establish and enforce standards for documenting data platform designs, including logical and physical data models, metadata, ETL specifications, and end-to-end integration workflows.

Design processes for ensuring data quality and integrity while providing timely responses to ad hoc requests.

Lead and execute proof-of-concepts where appropriate to assess, validate, and improve technical processes and approaches

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

3+ years of experience managing a mid-size team, at least 2 data engineers

3+ years of experience in the big data space

Experience in translating business requirements into technical data solutions on a large scale

Experience working on Spark (SparkSQL / Data Frames / Dataset API) using Scala/Python to build and maintain complex ETL pipelines.

Experience with Databricks

2+ years of experience working on AWS

Excellent communication skills, with the ability to clearly articulate complex technical concepts to non-technical stakeholders

Experience with GitHub and CI/CD processes

Experience driving operational excellence for large-scale data platforms, including reliability, scalability, performance and cost optimization

Similar Jobs

Car Sales Manager

The Hertz Corporation • Charlotte, NC • 8min ago

Management & Administrative

A Day in the Life: Car Sales Manager Manage retail business including sales process, finance, and sales team. Assist in the management of all other store processes as needed and support omni-channel sales. Wage: $43,888....

8min ago

Go to Apply

Regional Sales Manager

US Foods • Rock Hill, SC • 12min ago

Management & Administrative

ARE YOU A CURRENT US FOODS EMPLOYEE? PLEASE APPLY DIRECTLY THROUGH OUR INTERNAL WORKDAY CAREER SITE ( https://www.myworkday.com/usfoods/d/task/2998$47185.htmld ) Join Our Community of Food People! Responsible for managin...

12min ago

Go to Apply

U.S. Bank • Charlotte, NC • 7h ago

Management & Administrative

At U.S. Bank, we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it tak...

7h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.