The Data Engineer II is responsible for leading and completing all the tasks related to the data present with respect to the development, implementation, and support of data warehouse ETL/ELT solutions for Data Analytics & AI group. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety of operational platforms into the Azure cloud applying data engineering principles. The engineer should be able to make use of Azure tools and techniques to ingest and transform data. Participate in project scope definitions, and code reviews. Continue to learn innovative ideas and strategies regarding the creation and maintenance of useful datasets for the business. This role has an opportunity to grow into Senior Data Engineer II and further.

Responsibilities: • Develops scalable data pipelines and ETL processes supporting data transformations, data structures, metadata, data quality controls, dependency, and workload management in Azure cloud independently. • Integrate new solutions with existing data processes in assembling large, complex datasets that meet functional/non-functional requirements. • Provide high quality Azure Data solutions that adhere to design specifications utilizing multiple architectural components in design and development of client requirements. • Resolve production support incidents on data load processes. • Be able to estimate efforts for assigned tasks in agile delivery process. • Analyze and profile data effectively to provide effective solutions to meet stakeholders’ requirements. • Design and write quality code for assigned tasks associated with data integration, cleaning, transformation, and control of data in data analytics environment. • Maintain solution documentation. • Actively contribute to technical design sessions, requirements gatherings and adhere to standards and best practices. • Establish good working relationships within and across teams. • Learn domain knowledge to become proficient. • Take active part in training to further advance knowledge. • Help other team members to grow and learn. • Contribute to a team focusing on Agile delivery and applying agile principles in day-to-day work including story refinement. • Collaborates with other engineers, data analysts, business partners, and data scientists who need to interact with data platforms to understand data requirements, ensure the data architecture is feasible to implement accurately.

Basic Qualifications (These are the minimum qualifications you need to be considered for the job): • Bachelor’s degree in computer science or a related technical field • 4+ years of development and support experience in cloud data warehouse and modeling patterns in Synapse or similar • 2 – 5 years of experience with Big Data technologies in Azure/AWS cloud with Spark/Data Bricks • Proficient in writing any procedural database language (T-SQL, pgSQL, PLSQL or equivalent) • Strong core data concepts and how they are implemented in distributed cloud environment • Expert knowledge in at least one ETL tool such as SSIS, Informatica, Talend, AWS Glue, Azure Data factory or equivalent • In depth knowledge with relational, NoSQL data concepts, and different types of transactional and analytical data workloads. Specific experience with Delta Lakehouse is a plus. • Excellent in at least one programming language such as Python, or Scala in distributed cloud environment. • Knowledge about performance tuning of data processing jobs and SQL, with medium and large volumes of data.. • Effective in design, develop, enhance, debug, support, maintain and test data solutions to support business units. • Experience working in an agile Data team with 5+ members. • Excellent written and verbal communication skills. • Adapt quickly to change with a variety of people and work styles. • Ability to effectively convey messages in both written and verbal for technical concepts. • Enthusiastic to learn new concepts and able to follow guidance of senior team members.