Job Information
Insight Global Azure Data Engineer in North Vancouver, British Columbia
Job Description
Insight Global is seeking a Data Engineer to join a large retail client based in Vancouver. As a Data Engineer, you'll join a large retail client on their Data and Analytics team which plays a key role in developing reporting and analytics for key business units. The data engineer will join the Retail Product Squad which is currently working to generate Data Models as a Product for their Retail partners. This project aims to treat data models as products which can be developed, maintained and delivered collaboratively to their business teams. In sum, they will drive innovation, mentor junior team members, and collaborate across departments to align data engineering efforts with Retail business goals. In a fast-growing organization where dependency on data is rapidly increasing, they will be at the forefront of creating scalable, efficient, and robust data solutions.
They Will Be:
Leading the design and implementation of complex data pipelines and architectures, ensuring scalability, performance, and efficiency.
Optimizing data processing workflows for maximum performance and resource utilization.
Mentoring and guiding junior data engineers on best practices, coding standards, and project delivery.
Collaborating with cross-functional teams to align data engineering efforts with business goals.
Implementing & supporting team members in building robust data pipelines from different internal/external sources using Microsoft Stack and Azure BI services.
Creating reusable components for the rapid development of the data platform.
Participating in code reviews and ensuring adherence to coding standards and best practices.
Contributing to the evaluation and adoption of new technologies and tools related to data engineering.
Designing and implementing data pipelines for ingesting and processing data from NoSQL databases.
Optimizing machine learning model training and deployment pipelines for performance and scalability.
Leveraging Databricks Unity Catalog to manage and govern machine learning models and associated data assets.
Collaborating with data scientists to productionize machine learning models and integrate them into data pipelines.
Working with multiple IT and Product Owner stakeholders to interpret Data & Analytics needs and priorities from a technical perspective.
Providing technical design and coding assistance to the team to accomplish project deliverables as planned/scoped.
Utilizing agile methodology best practices to deploy tools iteratively.
Seeking out and identifying opportunities for improvements both within the team and within the department.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
5+ years as an Azure Data Engineer working with Azure Databricks, Azure Data Factory, and Azure Synapse Analytics
Strong experience using Python
Experience working on projects with Data Science components within predictive analytics (for example with SparkMLib)
Project Experience working with Data Models as a Product
Strong understanding of ETL and ELT processes with the ability to implement end-to-end solution flows for complex requirements
Proficient with Databricks Unity Catalog for model and data asset management.
Experience as a data engineer in a retail environment
Strong experience with downstream integrations with Power BI
Experience working at innovative companies such as Startups and or in Big Tech
Strong communication with a proactive and diligent approach to their work Experience with Access Control Lists (ACLs) for Data Security
Located in Vancouver to go onsite as needed null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.