Description:
We are in search of a Data Engineering Framework Architect with a specialty in designing and building innovative data solutions on AWS. The ideal candidate will have a deep understanding of data engineering frameworks such as DBT, SQLMesh, and Coalesce, and will lead the architecture and implementation of these frameworks within AWS EMR/Glue environments.
Key Responsibilities:
Ø Extensive experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.
Ø Proven Architect and design advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.
Ø Strong experience with DBT or similar framework and modern data architecture principles.
Ø Develop strategic plans for scalable data solutions, overseeing their implementation and maintenance.
Ø Define and enforce architectural standards and frameworks for data ingestion, processing, storage, and retrieval.
Ø Lead collaboration with cross-functional teams to ensure adoption of data engineering frameworks are leveraged to deliver solutions
Ø Provide mentorship and architectural guidance to the data engineering team.
Minimum Qualifications:
Ø Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
Ø 7+ years of experience in data engineering with a focus on AWS-based solutions.
Ø Proficient in designing and implementing data engineering frameworks such as DBT, SQLMesh, or Coalesce.
Ø Extensive knowledge of AWS services, particularly EMR and Glue.
Ø Strong grasp of data warehousing, ETL concepts, and data modeling techniques.
Preferred Qualifications:
Ø AWS Certified Solutions Architect or AWS Certified Big Data Specialty certification.
Ø Experience with infrastructure as code (e.g., Terraform, AWS CloudFormation).