Overview
At Intuit, we are the global financial technology platform dedicated to powering prosperity for millions of people and the communities we serve. Our Consumer Group, home to iconic products like TurboTax and Credit Karma, is at the heart of this mission.
We are seeking a Principal Software Engineer, Data Engineering to act as the primary technical leader and domain expert across multiple Data Engineering teams . This role is crucial for driving strategic transformation and defining the foundational technology for our high-scale data products . This is a unique opportunity to shape the future of data engineering architecture for the Consumer Group.
The successful candidate must operate with a "Builder Profile," possessing the mastery to identify and execute key opportunities that significantly boost engineering velocity across the company. This is a senior Individual Contributor (IC) role-no direct reports-where you will apply master-level software engineering and industry best practices to solve complex, end-to-end technical challenges, leading decisions that have a significant long-term impact **.
Responsibilities
Technical Craft and Architectural Leadership**
Strategy & Vision: Lead the implementation of the Consumer Platform data strategy, driving significant, end-to-end initiatives that align with the target state architecture.
Design Authority: Provide a "bird's-eye architecture view," clarifying rationale for all major Technical Decisions. Drive the design and implementation of durable, scalable, and secure technical designs for high availability.
Hands-On Execution: Act as a role model in full-cycle engineering, engaging in approximately 70% hands-on development. Lead critical projects (PoCs, pilot implementations) and mentor through live coding and collaborative problem-solving.
Data Strategy, Quality, and Velocity
Platform Standards: Define the technical strategy for data modeling, ingestion, curation, and data quality across the consumer platform. Establish the target state for real-time analytics pipelines.
Efficiency: Define and enforce technical standards and clear "paved paths" to accelerate velocity. Provide direction on smart execution to reduce rework and infrastructure overhead (e.g., optimizing EMR management).
Reliability: Define approaches for incident avoidance and "game day" preparedness, including establishing Data Quality (DQ) monitoring and comprehensive E2E testing. Ensure designs scale for future data volumes while optimizing infrastructure cost.
AI Native Applications and Innovation
AI Leadership: Possess the deep knowledge required for building and scaling AI native applications. Guide the applicability of AI/GenAI to customer problems, understanding both its value and limitations.
Champion Innovation: Champion and integrate emerging technologies, leveraging AI and Agentic experiences to create new opportunities and improve customer experiences.
Tooling Strategy: Provide direction to consolidate and manage the multiplicity of AI tooling silos to reduce organizational inefficiency.
Leadership, Mentorship, and Collaboration
Influence: Influence technology and product direction, typically driving work across multiple scrum teams. Act as the essential bridge between Product and Data Engineering, ensuring clear business @context (including data consumption patterns) is provided.
Mentorship: Provide comprehensive technical mentorship through personalized skill enhancement. Conduct detailed architecture and code reviews (including paired programming) to enforce standards and share advanced design principles.
Community: Contribute to standards, patterns, and best practices that elevate the entire engineering community.
Qualifications
BS or MS in Computer Science, Data Engineering, or a related field.
Strategic and Leadership Skills
Influence & Communication: Strong ability to influence and communicate clearly, succinctly, and persuasively with technical, product, and non-technical partners at all levels.
Strategic Mindset: Ability to synthesize achievable solutions from diverse inputs and complex data. Demonstrated experience driving technical strategy in high-scale environments.
Abstraction: Ability to operate at varying levels of abstraction, from business strategy and product strategy down to detailed technical design.
Technical Expertise and Experience
Experience: 15+ years of software engineering experience, with a strong background in data engineering.
Big Data: 9+ years professional working experience with core big data technologies: Hive, Hadoop, Kafka, Columnar Databases, and Graph Databases. Strong experience with stream processing/near real-time data ingestion is essential.
Languages: Expert proficiency with SQL, Python, and Linux. Expertise in JVM-based languages such as Java (Spring & Springboot) and Scala for Spark streaming/applications.
Architecture & Cloud: Strong understanding of extensible data modeling for large-scale data. Strong background in AWS (expertise specifically noted), operating high-scale, resilient services in the cloud.
Tools: Expertise with Docker, Spark, Scala, Kubernetes, Databricks Notebooks, and SageMaker.
AI/ML: Strong background in the adoption of AI skills in both traditional ML and Generative-AI applications.
Methodology: Expert knowledge of Agile Development, SCRUM, and/or Extreme Programming methodologies.
Intuit provides a competitive compensation package with a strong pay for performance rewards approach. This position will be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs (see more about our compensation and benefits at Intuit®: Careers | Benefits (https://www.intuit.com/careers/benefits/full-time-employees/) ). Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing fair pay for employees, Intuit conducts regular comparisons across categories of ethnicity and gender. The expected base pay range for this position is:
EOE AA M/F/Vet/Disability. Intuit will consider for employment qualified applicants with criminal histories in a manner consistent with requirements of local law.
