Senior Data Engineer, Solutions Architecture
San Francisco, California, United States
What The Role Is
We are seeking a talented Senior Data Engineer to design, build, and maintain our data infrastructure supporting mission-critical energy operations. You'll work at the intersection of renewable energy and data, developing pipelines that process everything from real-time asset performance data to complex trading and risk analytics. This hybrid role offers the opportunity to make a direct impact on clean energy operations while working with a cutting-edge data stack including Snowflake, Dagster, dbt, Modal, and GitLab.
What You'll Be Doing
Analytics Infrastructure & Data Warehouse Management
Design, deploy, and maintain scalable data infrastructure to support enterprise analytics and reporting needs
Manage Snowflake instances, including performance tuning, security configuration, and capacity planning for growing data volumes
Optimize query performance and resource utilization to control costs and improve processing speed
Data Pipeline Development & Orchestration
Build and orchestrate complex ETL/ELT workflows using Dagster to ensure reliable, automated data processing for asset management and energy trading
Develop robust data pipelines that handle high-volume, time-sensitive energy market data and asset generation and performance metrics
Implement workflow automation and dependency management for critical business operations
Data Transformation & Analytics Support
Develop and maintain dbt models to transform raw data into business-ready analytical datasets and dimensional models
Create efficient SQL-based transformations for complex energy market calculations and asset performance metrics
Support advanced analytics initiatives through proper data preparation and feature engineering
Data Quality & Governance
Implement comprehensive data validation, testing, and monitoring frameworks to ensure accuracy and consistency across all energy and financial data assets
Establish data lineage tracking and privacy controls to meet regulatory compliance requirements in the energy sector
Develop alerting and monitoring systems for data pipelines, including error handling, SLA monitoring, and incident response
CI/CD & DevOps
Lead continuous integration and deployment initiatives for Dagster and dbt pipelines, and Streamlit/Gradio application deployments to Linux servers
Implement automated testing and deployment automation for data pipelines and analytics applications
Manage version control and infrastructure as code practices
Cross-functional Collaboration
Partner with Analytics Engineers, Data Scientists, and business stakeholders to understand requirements and deliver solutions
Work closely with asset management and trading groups to ensure real-time data availability for market operations and risk calculations
Collaborate with credit risk teams to develop data models supporting financial analysis and regulatory reporting
Translate business requirements into technical solutions and communicate data insights to stakeholders
Documentation & Security
Create and maintain technical documentation, data dictionaries, and onboarding materials for data assets
Implement role-based access controls, data encryption, and security best practices across the data stack
Monitor and optimize cloud infrastructure costs, implement resource allocation strategies, and provide cost forecasting
What You'll Bring
Experience: 4+ years of hands-on data engineering experience in production environments
Education: Bachelor's degree in Computer Science, Engineering, or a related field
Data Orchestration: Proficiency in Dagster for pipeline scheduling, dependency management, and workflow automation; Airflow experience a plus
Cloud Data Warehousing: Advanced-level Snowflake administration, including virtual warehouses, clustering, security, and cost optimization
Data Transformation: Proficiency in dbt for data modeling, testing, documentation, and version control of analytical transformations
Programming: Strong Python and SQL skills for data processing and automation
CI/CD: 3+ years of experience with continuous integration and continuous deployment practices and tools; proficiency in GitLab CI/CD required (GitHub Actions experience a plus)
Database Technologies: Advanced SQL skills, database design principles, and experience with multiple database platforms
Cloud Platforms: Proficiency in AWS/Azure/GCP data services, storage solutions (S3, Azure Blob, GCS), and infrastructure as code
Data Integration: Experience with APIs, various data connectors, and formats
Data Security: Understanding of data security best practices, access controls, encryption, and role-based access management
AI & LLM Proficiency: Practical experience integrating and leveraging large language models (e.g., OpenAI, Anthropic, or open-source models) within data workflows; ability to apply LLMs efficiently and securely, with awareness of data privacy boundaries, prompt injection risks, and responsible AI usage in production environments
Problem-Solving: Strong analytical and troubleshooting skills with attention to detail
Communication: Ability to work effectively with both technical and business stakeholders
Work Style: Comfortable with a hybrid work environment (2-3 days in office); highly autonomous and self-directed with a strong work ethic and growth mindset; exceptional attention to detail; able to take ownership of projects end-to-end with minimal oversight
What Would Be Nice
Experience in the energy, utilities, or financial services industries
Knowledge of energy trading concepts, market data, or asset management
Familiarity with data governance frameworks and regulatory compliance (SOX, GDPR, CCPA)
Experience with infrastructure as code (Terraform, CloudFormation)
Clearway will not sponsor non-immigrant visas for this position (H-1B, TN, E-3, etc.).
LI-Hybrid
The pay rate for the successful candidate will depend on geographic location, skills, relevant and demonstrated experience, education, training and certifications, and other factors permitted by law. This role is eligible to earn an annual cash bonus, subject to personal and company performance goals.
Salary Range Across all U.S. Locations
$110,000-$145,000USD
Clearway Energy Group is leading the transition to a world powered by clean energy. Along with our public affiliate Clearway Energy, Inc., our portfolio comprises approximately 11.6 GW of gross generating capacity in 26 states, including 9.1 GW of wind, solar, and battery energy storage assets, and over 2.5 GW of conventional dispatchable power generation providing critical grid reliability services. As we develop a nationwide pipeline of new energy projects for the future, Clearway's operating fleet generates enough reliable electricity to power more than 3 million homes today. Clearway Energy Group is headquartered in San Francisco with offices in Denver, Houston, Phoenix, Princeton, and San Diego. For more information, visit clearwayenergygroup.com.
Our Commitment to Diversity, Equity, & Inclusion
Clearway Energy Group's vision is a world powered by clean energy. Along with our public affiliate Clearway Energy, Inc., our portfolio comprises approximately 11.8 GW of gross generating capacity in 26 states, including 9.1 GW of wind, solar, and battery energy storage assets, and over 2.8 GW of flexible dispatchable power generation providing critical grid reliability services. As we develop a nationwide pipeline of new energy projects for the future, Clearway's operating fleet generates enough reliable electricity to power more than 2 million homes today. Clearway Energy Group is headquartered in San Francisco with offices in Denver, Houston, Phoenix, Princeton, and San Diego. For more information, visit clearwayenergygroup.com.
Working at Clearway, Hybrid Together
Here at Clearway, we're committed to balancing flexibility while fostering strong relationships with our teammates. We do this by prioritizing corporate new hires based near one of our offices in San Francisco, San Diego, Scottsdale, Houston, Denver, & Princeton. Our office-based employees typically work together from fabulous spaces on Tuesdays & Thursdays to collaborate & learn, build community, get to know one another, & enjoy company-provided meals & events. Our site-based employees collaborate in-person daily to keep our locations operating safely and efficiently while fostering strong relationships within their local communities.
Clearway Energy is an equal opportunity employer that values a broad diversity of talent, knowledge, experience & expertise. We intentionally foster a culture of inclusion that empowers our employees to deliver superior performance to the communities we serve. We encourage minorities, women, individuals with disabilities & protected veterans to join the team. Clearway is a proud promoter of employment opportunities for our Military & Veterans.
What We Provide
Clearway offers all eligible employees working 20+ hours per week a comprehensive menu of benefits: generous PTO, medical, dental & vision care, HSAs with company contributions, health FSAs, dependent daycare FSAs, commuter benefits, relocation, & a 401(k) plan with employer match, a variety of life & accident insurances, fertility programs, adoption assistance, generous parental leave, tuition reimbursement, & benefits for employees in same-sex marriages, civil unions & domestic partnerships. For more on Clearway benefits, visit our Benefits Website (https://benefitsatclearway.com/) .
Notice to Applicants
Clearway Energy is strongly committed to a philosophy of equal opportunity and fully complies with equal employment laws (https://www.dol.gov/sites/dolgov/files/ofccp/regs/compliance/posters/pdf/eeopost.pdf) , ordinances, and regulations for all applicants and employees. We will make reasonable accommodations to enable individuals with disabilities to apply and compete for employment opportunities for which they are qualified. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to recruiting@clearwayenergy.com and let us know the nature of your request and your contact information.
All official communication regarding this position will come only from an email address ending with @clearwayenergy.com. If you receive outreach from any other email address claiming to represent Clearway Energy, please do not respond, as it is fraudulent.
Notice to California Applicants (https://www.clearwayenergygroup.com/california-consumer-protection-act-applicant-notice/)
Clearway Energy is strongly committed to a philosophy of equal opportunity and fully complies with equal employment laws (https://www.dol.gov/sites/dolgov/files/ofccp/regs/compliance/posters/pdf/eeopost.pdf) , ordinances and regulations for all applicants and employees.
Create a Job Alert
Interested in building your career at Clearway Energy? Get future opportunities sent straight to your email.
