Back to Jobs search

PRINCIPAL DATA ENGINEER

Dollar General • Goodlettsville, TN • 3h ago

Job Identification 677

Job Category Applications & Engineering

Job Schedule Full time

Travel Required No

Willing to Relocate No

Expected Pay 163,000-170,000

Job Description

A Principal Data Engineer is responsible for expanding and optimizing data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. This role involves building and optimizing data systems from the ground up, ensuring that data delivery architecture is consistent throughout ongoing projects. The Principal Data Engineer supports software developers, database architects, data analysts, and data scientists on data initiatives, ensuring optimal data delivery and architecture. This position requires expertise in data pipeline building and data wrangling, with a focus on enhancing data systems for improved efficiency and performance.

Job Responsibility

Develop, construct, test, and maintain data architectures: responsible for creating and maintaining optimal data pipeline architectures necessary for the organization's operational efficiency. (65%)

Collaborate with data scientists and other stakeholders: expected to collaborate with data scientists, business analysts, IT professionals, and management to assist with data-related technical issues and support their data infrastructure needs. (10%)

Assemble and prepare large, complex data sets to meet functional business requirements: required to work with different teams to understand their data needs and ensure those needs are met. (10%)

Build analytics tools: This will involve developing tools that utilize the data pipeline to provide actionable insights into key business performance metrics. (5%)

Maintain data security and compliance: ensure systems meet industry practices and business requirements for data privacy and protection. (5%)

Identify, design, and implement internal process improvements: This includes optimizing data delivery, automating manual processes, and re-designing infrastructure for greater scalability. (3%)

Keep up-to-date with the latest technology trends: Continually learn and adapt to new technologies that could improve existing systems. (2%)

Job Qualifications

Hands on experience with programming languages (e.g. Python, SQL, GoLang)

Knowledge with SQL database design concepts and Data Models

Great numerical and analytical skills

Degree in Computer Science, IT, or similar field; a Master's is a plus

Data engineering certification (e.g., Cloud Engineer, Data Engineer) is a plus

Experience with big data tools: Hadoop, Spark, Kafka, etc.

Experience with relational SQL and NoSQL databases, including MongoDG, Postgres and/or Cassandra.

Experience with data pipeline and workflow management tools: Airflow, Dataflow, Composer, etc.

Experience with GCP, Snowflake, Azure cloud services: BQ, Dataflow, Redshift

Experience with stream-processing systems: Kafka, Spark-Streaming, etc.

Good knowledge of software engineering principles, methodologies, and current best practices.

Able to multitask and shift priorities as needed.

Able to use BI Tools for data analysis and data QA.

Education/Experience

9+ years experience and a degree in information technology or computer science with additional vendor-specific certification.

BS or MS degree in Computer Science or a related technical field

4+ years of Python or Java development experience

4+ years of SQL experience (No-SQL experience is a plus)

4+ years of experience with schema design and dimensional data modeling

Ability in managing and communicating data warehouse plans to internal clients

Experience designing, building, and maintaining data processing systems

Experience working with a cloud platform such as Snowflake / Azure or Databricks

About Us

Work Where You Matter

At Dollar General, our mission is Serving Others! We value each and every one of our employees. Whether you are looking to launch a new career in one of our many convenient Store locations, Distribution Centers, Store Support Center or with our Private Fleet Team, we are proud to provide a wide range of career opportunities. We are not just a retail company; we are a company that values the unique strengths and perspectives that each individual brings. Your difference truly makes a difference at Dollar General. How would you like to Serve? Join the Dollar General Journey and see how your career can thrive.

Company Overview

Dollar General Corporation has been delivering value to shoppers for more than 80 years. Dollar General helps shoppers Save time. Save money. Every day.® by offering products that are frequently used and replenished, such as food, snacks, health and beauty aids, cleaning supplies, basic apparel, housewares and seasonal items at everyday low prices in convenient neighborhood locations. Learn more about Dollar General at www.dollargeneral.com/about-us.html.

Full-stack Engineer 5 - Shopping (Remote-Eligible)

Capital One • Nashville, TN • 1w ago

IT & Engineering

Full-stack Engineer 5 - Shopping (Remote-Eligible) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative deliv...

1w ago

Go to Apply

Senior Specialist, Systems Engineer

L3Harris • Nashville, TN • 1w ago

IT & Engineering

L3Harris is dedicated to recruiting and developing high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers' mission and quest for professional growt...

1w ago

Go to Apply

Manufacturing Electrical Engineer

Insteel Industries, Inc. • Gallatin, TN • 1w ago

IT & Engineering

Position Snapshot The Manufacturing Electrical Engineer supports the design, installation, optimization, and maintenance of electrical systems used in production environments. The role ensures equipment reliability, impr...

1w ago

Go to Apply

Software Engineer III

Pearson • Nashville, TN • 1w ago

IT & Engineering

Software Engineer III What You'll Do Design, build, and maintain Ruby on Rails services and APIs alongside modern JavaScript/React frontends, taking responsibility for their quality, performance, and reliability Lead the...

1w ago

Go to Apply

Software Engineer II

Akamai Technologies, Inc. • Nashville, TN • 1w ago

IT & Engineering

Job Title: Software Engineer II Work Location: 145 Broadway, Cambridge, MA 02142 Job Description: Akamai Technologies, Inc. is hiring for the following role in Cambridge, MA (multiple openings): Software Engineer II. Dev...

1w ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)