Lead Data Engineer
Job Type: Full Time / Permanent
We are looking for a Lead Data Engineer to join our passionate team, adding your background and experience making us even stronger. In this role, you will build dataset and make them accessible to our partner teams by writing great code to simplify the complexity and ensure quality. Your work will enable product teams, data science, and decision-makers across the company to bring together insights and inform our business. We are constantly seeking to improve ourselves. We believe that trusted, easy to consume data is the critical and as a Lead Data Engineer your work will help to build that foundation.
What you will do: Design, develop, and launch extremely efficient and reliable data pipelines to move data and to provide intuitive analytics to our partner teams. Make data more discoverable and easier to use for Data Scientists, Analysts and Other Product teams across the company. Mentor and Lead engineering teams and team members in software delivery within Data in an Agile Environment. Own complete solution across entire life cycle while utilizing strong problem-solving ability. Lead design sessions and code reviews to elevate the quality of data engineering across the organization. Participate in an on-call rotation for support during and after business hours.
What you bring: 10+ years of experience in data software development, using data technologies such as Relational & NoSQL databases, open data formats, building data pipelines (ETL and ELT) with batch or streaming ingestion, loading and transforming data, and developing with big data technologies such as Spark, MapReduce B.S. and/or M.S. in Computer Science or a related technical field, or equivalent work experience Mastery of SQL language and relational databases (MSSQL, Oracle, DB2, etc.) 5+ years of experience in one or more of the following: Python (Preferred), Scala, C++, or Java 3+ years of experience with at least one of the following cloud platforms: Microsoft Azure (Preferred), Amazon Web Services (AWS), or Google Cloud Platform (GCP) Experience with cloud-based data warehouses – e.g. Snowflake, BigQuery, Synapse, RedShift, etc. Strong grasp of data management principles: Data Lake, Data Mesh, Data Catalog, Data Quality, etc. Experience in BI tooling such as Qlik, MicroStrategy, Tableau, PowerBI or Looker Strong communication skills across different mediums to craft compelling messages to drive action and alignment Comfort with agile delivery methodologies in a fast-paced complex environment – Scrum, SAFe, utilizing tools such as Jira, Confluence, and GitHub Knowledge or exposure to supporting AI/ML engineering and integrating data to model development, management and serving. Ideal candidates will have experience working with one of the following industries: Retail, Supply Chain, Logistics, Manufacturing or Marketing Proficient in Linux/Unix environments.