Senior Data Engineer
Carlisle

Job Info

Carlisle Weatherproofing Technologies (CWT) is a leading supplier of building envelope solutions that effectively drive energy efficiency and sustainability in commercial and residential applications. We are looking for a Senior Data Engineer to join our team remotely.

Job Summary:

The Senior Data Engineer will be responsible for designing and implementing data transformation and integration processes to consolidate data from diverse ERP systems such as SAP ECC and JD Edwards (JDE) into a single cloud-based environment. Additionally, the role involves evaluating and selecting an Enterprise Data Platform (EDP) and overseeing its implementation. Expertise in ETL/ELT tools is crucial for this position. Experience in Databricks, Azure Data Factory, Snowflake, Azure OneLake, Python and SQL DB is desired.

As a Senior Data Engineer, you will provide expert guidance and mentorship to other Data Engineers on the team while actively participating in design and development of data pipelines that lead Business Intelligence, Data Science, and Machine Learning use cases throughout the organization.

This role involves a variety of projects aimed at developing canonical data sources to enable the business to derive trustworthy, actionable insights. Most importantly, you will help bring our data technologies to a wide range of consumers and supporting our operation, supply chain, FP&A and sales organizations

This role we be a remote first role reporting into our Director, Data Analytics & Governance out of our Kimberton, PA HQ.

Duties and Responsibilities:

Enterprise Data Platform Selection:

* Provide technical leadership during the evaluation and selection process for the Enterprise Data Platform, including gathering requirements, assessing vendors, and working on pilots.
* Collaborate with stakeholders to define acceptance criteria and make data-driven recommendations.

Data Integration and Transformation:

* Design, develop, and implement ETL/ELT processes to integrate data from SAP ECC, JD Edwards, and other ERP systems into a cloud-based data platform.
* Utilize Alteryx and other ETL/ELT tools to streamline data extraction, transformation, and loading processes.
* Participate in creation of Conceptual / Logical / Physical data models and drive business requirements to lead to creation of consolidated Enterprise Data Platform (EDP).

Implementation and Optimization:

* Oversee the implementation of the chosen EDP, ensuring alignment with organizational needs and best practices.
* Optimize data pipelines, performance, and system integrations to ensure efficient data processing and storage.
* Design scalable and reliable data processes to move and use data efficiently for analytics and data science needs.
* Transform / consolidate / mine data using SQL, ETL/ELT processes and through Python code.

Data Quality and Governance:

* Establish and enforce data quality standards and governance practices to ensure data integrity and consistency across integrated systems.
* Monitor and address data quality issues, implementing solutions as needed.

Collaboration and Communication:

* Work closely with cross-functional teams, including data analysts, business analysts, and ERP administrators, to understand data requirements and deliver solutions.
* Provide technical expertise and guidance to team members and stakeholders regarding data transformation and integration.
* Drive pragmatic approaches to solve complex business problems through providing data models suited for business intelligence / analytics tools such as PowerBI.
* Work with engineering teams to enable the appropriate capture and storage of data.
* Expectation to understand, participate in, and support company COS initiatives, with focus on developing a lean mindset.
* Other duties as assigned.

Knowledge/Skills/Abilities:

* Expert knowledge of data modeling, data warehousing, and big data technologies.
* Understanding of data privacy regulations and best practices related to storing PII.
* Experience with dimensional model design (star schema), Kimball DW concepts, conversion of data stored in 3NF to denormalized form geared for reporting.
* Proven track record of delivering significant business impact, with a solid track record in Finance, Supply Chain, Sales, Marketing or other verticals preferred.
* Experience building cloud-native applications, for example with Microsoft Azure, AWS or GCP

Working Conditions:

* Office setting or dedicated workspace in a home office setting
* Ability to high-speed internet connection to facilitate video calls, CRM management and other project related activities.

#LI-MW1

Education and Experience:

* Required:

* Bachelor's degree in computer science, Data Science, Information Systems, or a related field.
* 8-10 years of experience in Data Engineering, Analytics, or Software Engineering.
* Previous experience of 3-5 years working with ERP platforms such as JD Edwards / SAP ECC / SAP HANA, MS Great Plains / Dynamics to retrieve and consolidate data in the Data Warehouse.
* Experience with cloud solutions based on Azure Fabric / Synapse, SQL DB, Snowflake or AWS Redshift.
* Minimum of 3 years of experience developing in Azure Databricks or Jupyter Notebooks environment, commendable knowledge of Python and Spark.
* Preferred:

* Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer, Azure Data Scientist, Snowflake: SnowPro Data Engineer)
* 5-8 years of experience with enterprise-level ETL/ELT systems - Alteryx, Azure Data Factory or Informatica is highly desired.

Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabled