We are seeking a skilled Data Engineer to design, implement, and optimize data solutions using Azure Databricks. In this role, you will work closely with cross-functional teams to ensure the efficient and reliable flow of data across our organization.
Key Responsibilities
Data Pipeline Management: Design, build, and manage data pipelines using Azure Databricks, Azure Data Lake, Synapse, and Azure Data Factory.
ETL/ELT Processes: Develop and maintain ETL/ELT and streaming processes to integrate data from diverse sources.
Data Management: Design and oversee data collection, storage, and analysis for operational reporting and business intelligence.
Performance Optimization: Ensure the performance, quality, and responsiveness of data pipelines.
Data Modeling: Create scalable and flexible data models to support current and future business needs, including developing a portfolio of data products.
Innovation: Stay updated with emerging trends and technologies to identify opportunities for innovation and improvement.
Role Qualifications
Education & Experience
Required
Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field.
Minimum of 3 years of practical experience in data architecture or a similar role.
Strong proficiency with Azure Databricks, Azure Data Lake, Azure Data Factory, Synapse, Python, and SQL.
Proven expertise in designing and implementing data warehouse solutions, including ETL/ELT processes, data integration, and data quality.
Experience with Agile methodologies and DevOps practices.
Excellent written and verbal communication skills.
Ability to work effectively in a team environment.
Preferred
Azure Data Engineering or Data Architecture certifications.
Experience with distributed computing and handling large-scale datasets.
Key Competencies
Results-Oriented: Ability to plan, schedule, and organize tasks to achieve strategic goals within or ahead of established time frames.
Adaptability: Flexibility and supportiveness, with the ability to swiftly and positively adapt to changes in a rapidly growing environment.
Interpersonal Communication: Effective communication skills, including the ability to understand and manage your own emotions and influence the emotions of others.
Team Orientation: Ability to build and maintain collaborative relationships, working effectively with team members through shared responsibility and mutual respect.
Accountability: Strong sense of ownership and personal responsibility for decisions, actions, and results; embraces experimentation and creativity.
Cultural Competence: Understanding and respect for diverse cultural values and beliefs; ability to consider and respond appropriately to cultural differences in planning and implementation.
Working Conditions
Environment: Work is conducted indoors in a typical office setting, with no significant exposure to adverse environmental conditions.
Physical Requirements: Must be able to lift up to 15 pounds.
Equipment Use: Frequent use of office equipment, including telephone, computer, and printer.
If you are passionate about leveraging data to drive business success and thrive in a collaborative environment, we encourage you to apply for this exciting opportunity.