|
Search Jobvertise Jobs
| |
Jobvertise
|
Azure Data Engineer - SQL/Python
Location: IN-Other West Bengal
Jobcode: indigojobs_650500
Email Job
| Report Job
Job DescriptionJob Description We are seeking a skilled Azure Data Engineer to join our team on a contract basis. This position is for one of our clients based out of UK who is working in Telecom & Insurance domains. The Role This is a typical Data Engineering role. Day to day you will be ingesting large data sets for our clients, which involves designing data pipelines, data integration and transforming data into models for downstream consumption. Clients will be in a variety of industries such as telecoms, insurance and mortgages. Required Skills And Experience Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server. Proficiency in SQL and Python languages. Hands-on experience in designing and building data pipelines using Azure Data Factory (ADF). Familiarity with building metadata driven pipelines. Knowledge of Azure Storage, Medallion Architecture, and working with data formats such as JSON, CSV, and Parquet. Strong understanding of IT concepts. including security, IAM, Key Vault, and networking. Exposure to Apache Airflow and DBT is a bonus. Familiarity with agile principles and practices. Experience with Azure DevOps pipelines. Nice To Have Certification in Azure or related technologies. Experience with other cloud platforms (e.g., AWS, Google Cloud). Knowledge of big data technologies Familiarity with data governance and compliance frameworks. Key outputs for the role Develop and maintain data pipelines using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation. Data Modelling using Kimball, 3NF or Dimensional methodologies Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server. Design and implement metadata driven pipelines to automate data processing tasks. Collaborate with cross-functional teams to understand data requirements and implement appropriate solutions. Ensure data quality, integrity, and security throughout the data pipeline. Troubleshoot and resolve any issues or errors in the data pipelines. Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Required Characteristics Driven by delivering quality work, with a great eye for detail Takes accountability and ownership of tasks, and finds the best way to solve problems Excellent communicator who can make sense of and communicate complex ideas to audiences of differing levels of seniority and technical ability Ability to quickly understand client context and demonstrate expertise in their business Relationship builder, with the ability to motivate and engage effectively to build trust with clients and colleagues. An interest in industry trends, emerging technologies, and client's businesses Ability to take the lead and drive initiatives independently (ref:hirist.techEmployement Category:Employement Type: Full timeIndustry: Others Role Category: Others Functional Area: Not ApplicableRole/Responsibilies: Azure Data Engineer - SQL/Python
Quess It Staffing
|
|
|
