INTL India - Onsite Lead Data Engineer (Databricks and Snowflake

Insight Global • Tempe, AZ • 7h ago

Job Description

A client in Charlotte, NC is looking for Lead Data Engineer to join their team. As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering the organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities. Responsibilities are shown below:

Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.

Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.

Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.

Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.

Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc

Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.

Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.

Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.

Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.

Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.

Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\EEOC\KnowYourRights6.12ScreenRdr.pdf) .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

Must be onsite 5 days per week

8+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses

3+ years of experience working as a lead and developing/mentoring other engineers

Experience working with Snowflake

Strong proficiency in SQL, Python and Spark programming languages

Strong experience with cloud platforms such as AWS, Azure, or GCP

Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks

Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.

Experience in implementing CI/CD pipelines for automating build, test, and deployment processes

Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices

Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Similar Jobs

Lead Machine Learning Engineer

Wells Fargo • Chandler, AZ • 7h ago

IT & Engineering

About this role: Wells Fargo is seeking a highly skilled and experienced Lead Machine Learning Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining AI platforms...

7h ago

Go to Apply

Data Analytics Engineer

Procter & Gamble • Phoenix, AZ • 8h ago

IT & Engineering

Job Location IVORYDALE INNOVATION CENTER Job Description If data is in your blood, then we have the job to get your heart pumping! From day 1, you'll be a key member of the engineering team driving end-to-end data and an...

8h ago

Go to Apply

Orthodontic Tech Assistant

All In One Benso Family Dental • PHOENIX • 9h ago

IT & Engineering

******** $500 SIGN ON BONUS******** All In One Benso Family Dental is excited to announce the opening for a dedicated and skilled Orthodontic Tech Assistant. This full-time position affords a unique opportunity for quali...

9h ago

Go to Apply