Senior Data Engineer

REAL PAGE INC • Richardson, TX • 2w ago

RealPage, Inc. seeks a Senior Data Engineer to d

esign, develop, and maintain data pipelines that ingest, transform, and load data from various sources into data lakes, data warehouses, and data marts using Python, Spark and other cloud services to serve analytics needs and machine learning model requirements. Contribute to the detailed design and architecture of the data platform ensuring consistency, efficiency and reusability of data components and processes. Perform data cleansing and validation using SQL/PySpark and other tools and frameworks to remove or correct erroneous, incomplete, or inconsistent data. Apply data transformations and implement business logic using SOL, Python and Spark to enhance, enrich, or standardize data. Handle large-scale and complex data sets using distributed systems and parallel computing to improve performance of the pipelines. Monitor, troubleshoot, and optimize the performance and cost of data pipelines and data cleansing and transformation solutions using diagnostic tools and metrics such as CloudWatch, Datadog. Research and evaluate tools and technologies to improve the data platform capabilities. Implement security, and compliance standards and policies across data pipelines and data sets using techniques like data masking, encryption, tokenization, and other techniques to hide personally identifiable information (PII) data and be compliant with CCPA, GDPR. Collaborate with data architects, data analysts, data scientists, and business stakeholders. Deploy cloud infrastructure applicable for data pipelines using terraform or cloud formation templates. Remote work permitted.

The position requires a Masters degree in Computer Science, Computer Engineering, or a related field of study and three (3) years of experience in the job offered or in a software and/or data engineering role. Employer will accept a Bachelors degree in Computer Science, Computer Engineering, or a related field of study and five (5) years of experience in the job offered or in a software and/ore data engineering role. The position requires a minimum of three (3) years of experience with the following skills and technologies: Python and SOL; building data models and data warehousing with Redshift/Snowflake/Big Query; optimizing queries and data pipelines; working with distributed systems using Apache Spark/AWS Glue/Databricks; working with public cloud offerings like AWS, Azure or GCP and their data/analytical services; deploying cloud resources such as virtual machines, storage, networks, databases; experience with terraform/CloudFormation templates. The position requires experience with the following skills: data warehousing/data platform principles such as SCDs, data partitioning, data retention, data lineage; implementing automated data quality checks for tracking and reporting data anomalies; building real time pipelines using message streams like Kinesis/Kafka/Data streams; working with message queues like SOS/Java MQs; implementing data security and compliance standards (CCPA/GDPR), data encryption/obfuscation. Remote work permitted.

To apply, go to: realpage.com/careers, click careers in the U.S. and search SENIO008089

Similar Jobs

Senior Software Development Engineer

CVS Health • Irving, TX • 1d ago

IT & Engineering

At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care. As the nation's leading health solutions compan...

1d ago

Go to Apply

Software Developer

THE TOY FACTORY LLC • Dallas, TX • 1d ago

IT & Engineering

POSITION: Software Developer JOB DESCRIPTION: Perform advanced data visualization and analysis tasks using Tableau Desktop and Tableau Server architecture Create customized annual reports using Pytex, Apply VDB in effici...

1d ago

Go to Apply

Software Engineer III - Fullstack

JPMorgan Chase • Plano, TX • 1d ago

IT & Engineering

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Consumer & Community Banking Payments Engineer...

1d ago

Go to Apply

Frontend Software Engineer III, REACT

JPMorgan Chase • Plano, TX • 1d ago

IT & Engineering

1d ago

Go to Apply

Software Engineer III - UI/UX

JPMorgan Chase • Plano, TX • 1d ago

IT & Engineering

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Software Engineer III UI/UX developer at JPMorgan Chase within the Consumer & Community Ban...

1d ago

Go to Apply

Java/Mulesoft developer

Fiserv • Frisco, TX • 1d ago

IT & Engineering

Calling all innovators - find your future at Fiserv. We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world. We connect financial institutions, corporations...

1d ago

Go to Apply

Senior Machine Learning Operations Engineer

CVS Health • Irving, TX • 1d ago

IT & Engineering

1d ago

Go to Apply

Xray Tech

Health Advocates Network • Dallas, TX • 1d ago

IT & Engineering

Benefits We Offer: Comprehensive health, prescription, dental, vision, life, and disability plans Competitive pay rates Referral opportunities ? Refer a friend & Cash in! Travel reimbursement and per diem allowances...

1d ago

Go to Apply

Lead Developer

Publicis Groupe • Irving, TX • 1d ago

IT & Engineering

Overview Employer: Epsilon Data Management LLC Job Title: Lead Developer Job Requisition: 6630.7455.7 Job Location: 6201 Connection Drive, Irving, TX 75039. Required to work from Company Office (Irving, TX) certain days...

1d ago

Go to Apply

Oracle Technical Developer

Deloitte • Dallas, TX • 1d ago

IT & Engineering

Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Oracle Technical Developer you will have the ability to share new ideas and collaborate on proj...

1d ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.