Description
Senior Data Engineer Opportunity
We are seeking a Senior Data Engineer who is experienced in analyzing systems and processes to define new data structures that can answer business questions. The ideal candidate can take structured and unstructured data sources and transform them into common views. They understand the multitude of ways source data can be corrupted or broken and can build pipelines that accommodate these issues.
Key Responsibilities
- Design, build, and optimize data pipelines to ingest, process, and transform large volumes of structured and unstructured data from multiple sources.
- Implement data integration solutions to enable seamless data flow between systems and applications.
- Develop and maintain scalable data storage solutions, including data lakes, data warehouses, and databases.
- Design and implement data models, schemas, and ETL processes to ensure data accuracy, consistency, and reliability.
- Collaborate with cross-functional teams to gather requirements, define data processing workflows, and deliver data-driven solutions.
- Perform data profiling, cleansing, and quality assurance tasks to ensure data integrity and usability.
- Monitor and optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness.
- Implement data security and privacy measures to protect sensitive information and comply with regulatory requirements.
- Stay current with industry trends, technologies, and best practices in data engineering and analytics.
Qualifications
- 10+ years of experience in data engineering, with a focus on building and optimizing data pipelines.
- 5+ years of experience with Python programming.
- 10+ years of experience in SQL and database management systems. PostgreSQL experience is a plus.
- 3+ years driving architectural vision across multiple teams
- Experience with database design and entity-relationship diagrams (ERD).
- Knowledge of star schema, snowflake schema, and differences between OLTP and OLAP systems.
- Understanding of normalization forms and query optimization.
- Experience with ETL/ELT processes, and Apache Airflow.
- Bachelor’s Degree in Computer Science or another relevant field. Advanced degree is a plus.
- Experience working Spark, Databricks, Snowflake a major plus
Experience in fast paced, startup environments. Understands what it takes for a team to win in competitive environments and relishes the challenge.
What We Offer
- Competitive compensation including equity
- A key founding team role as part of an exciting growth journey
- Excellent benefits including medical, dental, vision, 401K and flexible PTO
- Learning from the best - passionate co-workers and a hands-on and engaged leadership team
- Work that matters
