The Azure Data Engineer is part of the Data Management’s Design & Development group within JRI-A and is responsible for designing, building, deploying, and maintaining the Cloud Azure Data Lake using the Azure Data Factory.
The Azure Data Engineer designs, develops, maintains, and supports the Data Lake ETL using the Azure Data Factory, and will play a key role in supporting the growth and scale of our technology infrastructure. This role is also responsible for complex interface process development, troubleshooting issues, supporting weekend maintenance and production support of the interface processes development by the ETL Design & Development team. Reports to the Team Leader. Has no direct/indirect reports.
+ Develop data pipelines / APIs using Python, SQL and Azure.
+ Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.
+ Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions.
+ Analyze and design technical solutions on Azure to address business needs.
+ Develop, test, and modify software to improve efficiency of data platforms and applications.
+ Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate and insightful outcomes.
+ Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
+ Collaborating with data scientists to integrate algorithms and models into automated processes.Applying expertise, judgment, and precedents to contribute to the resolution of moderately complex problems.
+ IT professional experience in Azure Cloud with over 3 years of Azure Development and 5+ years of any ETL development experience
+ Worked on multiple projects as developer using Data factory from data receiving, validation, transform and then publish
+ Worked on Data Factory Pipelines and AppLogic after gathering and translating end user requirements
+ Ability to recreate existing legacy application logic and functionality into Azure Data Factory/Data Lake, SQL Database and SQL Datawarehouse environment.
+ Excellent interpersonal and communication skills
+ Experience with software configuration management tools such as Git/Gitlab
+ Experience with continuous integration and deployment (CI/CD) tools such as Azure DevOps
**Job Locations** _US-NJ-Jersey City_
**Posting Date** _2 months ago_ _(6/9/2022 1:34 PM)_
**_Career Category_** _Information Technology_
**_iCIMS ID_** _2022-12474_
**_Corporate Title_** _Associate_
**_Type_** _Fulltime-Regular (Exempt/Non-Exempt)_
_SMBC is an EO employer – M/F/Veteran/Disability_