Distinguished Data Engineer
AI summary of the role
Capital One seeks a Distinguished Data Engineer to define the strategic roadmap for the data ecosystem on AWS, leading the design and implementation of scalable architectures integrating Databricks and Snowflake.
What you’ll do
- Define and champion the strategic roadmap for adoption, governance, and cost-optimization of the data ecosystem leveraging Databricks and Snowflake on AWS.
- Lead design and implementation of highly scalable, fault-tolerant, and cost-effective data architectures integrating Databricks and Snowflake.
- Serve as primary technical authority for data security and governance within Databricks and Snowflake, integrating with AWS security services.
- Drive performance engineering and optimization for large-scale data ingestion and processing workloads across the Databricks/Snowflake/AWS pipeline.
What you’ll bring
- Bachelor’s Degree
- At least 7 years of experience in data engineering
- At least 3 years of experience in data architecture
- At least 2 years of experience building applications in AWS
Technologies
Databricks · Snowflake · AWS · Delta Lake · Unity Catalog · MLflow · Snowpipe · Terraform · Python · SQL
Source and classification
Internal deployment & tooling · Evidence for this classification:
buy-in. Strike the right balance between lending expertise and providing an inclusive environment where others’ ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team Promote a culture of engineering excellence, using opportunities to reuse and inner source solutions where possible Effectively communicate with and influence key stakeholders across the enterprise, at all levels of the organization Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner Lead the way in creating next-generation talent for Tech, mentoring internal talent and actively recruiting external talent to bolster Capital One’s Tech talent. Define and champion the strategic roadmap for the adoption, governance, and cost-optimization of the data ecosystem leveraging
More from the job description
Distinguished Data Engineer Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to deliver next generation technology solutions. You will work alongside our talented team of developers, machine learning experts, product managers and people leaders. Our Distinguished Engineers are leading experts in their domains, helping devise practical and reusable solutions to complex problems. You will drive innovation at multiple levels, helping optimize business outcomes while driving towards strong technology solutions. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. You will promote a culture of engineering excellence, and strike the right balance between lending expertise and providing an inclusive environment where the ideas of others can be heard and championed. You will lead the way in creating next-generation talent for Capital One Tech, mentoring internal talent and actively recruiting to keep building our community. D [... source excerpt omitted ...] atforms and capability domains, creating clear and concise communications, code samples, blog posts and other material to share knowledge both inside and outside the organization. You will specialize in a particular subject area, but your input and impact will be sought and expected throughout the organization. Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices Visionaries, collaborating on Capital One’s toughest issues, to deliver on business needs that directly impact the lives of our customers and associates Role models and mentors, helping [... source excerpt omitted ...] and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities. Responsibilities: Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in. Strike the right balance between lending expertise and providing an inclusive environment where others’ ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team Promote a culture of engineering excellence, using opportunities to reuse and inner source solutions where possible Effectively communicate with and
Employer postings · Data from · Sources