SQL Developer with ETL experience - Coimbatore location

Job Description:

SQL Server Developer with 10 years experiences
Job Title: SQL Developer with ETL experience
Location: Coimbatore

Position Overview: We are looking for an experienced ETL Developer to join our team. The
ideal candidate will have a minimum of 6 years of hands-on experience in SQL development
with exposure to ETL process for 3 years (latest) and ETL tools for migrating the data from
one system to another. Developer will be responsible for designing, implementing ETL
pipelines and designing, developing, and maintaining complex SQL queries and procedures
to support critical business applications. Additionally, the candidate shall have experience in
database architecture and be capable of providing technical leadership in optimizing SQL
code for maximum performance.

Key Responsibilities:
 Data Management and Storage:
o Design and implement data storage solutions using Azure services like Azure
SQL Database, Azure Data Lake Storage, and some experience of Azure
Cosmos DB.
o Ensure data storage systems are scalable, performant, and cost-effective.
o Perform database performance tuning and optimization, including query
optimization, index tuning, and database configuration would be an
advantage
o Write Unit Tests for database objects like stored procedures.
 Data Integration and ETL:
o Develop and manage ETL (Extract, Transform, Load) processes using Azure
Data Factory to integrate data from various sources.
o Ensure data is efficiently cleaned, transformed, and loaded into data
warehouses or data lakes.
o Gather and process raw data at scale (including writing scripts, web scraping,
calling APIs, write SQL queries, writing applications and good knowledge of
Entity Framework)
o Primarily use the skills above to perform multiple data migrations from
existing operational systems, or data extracts, into our live multi-tenanted
system, to tight deadlines with minimal operational downtime.
o Investigating data to anticipate any pipeline issues.
 Big Data and Analytics:
o Utilize big data technologies such as Azure Databricks and Apache Spark for
data processing and analytics.
o Create data processing workflows and pipelines to support data analytics and
machine learning applications.
o Use Power BI and Embedded Power BI to visualise the data and create
insights to effect Operational process improvements.

 Data Security and Governance:
o Implement data security measures and ensure compliance with data
governance policies.
o Monitor and optimise data storage and processing solutions for security and
performance.

 Collaboration and Troubleshooting:
o Work closely with data developers, migration experts, data scientists,
analysts, and other stakeholders to understand data requirements and create
effective data workflows and database schemas.
o Identify and troubleshoot operational and data quality issues and assist our
development and support teams in identifying and rectifying production data
issues

 Collaboration & Upskilling:
o Stay abreast of emerging trends and technologies.
o Document database design, schema, and procedures

Requirements:
 Minimum of 3 years of hands-on experience in Azure services like Azure SQL
Database, Azure Data Lake Storage, and some experience of Azure Cosmos DB.
 Expert level proficiency in ETL process and tools like SSIS or ADF.
 Experience with data assessments, mapping data between data structures and
matching data to new data structures, data modelling & data quality management.
 Experience with effective resource management, risk identification and management,
and progress monitoring.
 Expert-level proficiency in SQL programming and database concepts.
 Experience in performance tuning and optimization techniques.
 Strong analytical and problem-solving skills.
 Experience in database projects and DACPAC.
 Experience with TsqlT Unit Tests or database unit test concept.
 Ability to work independently and in a team environment.
 Experience in powerbi report creation is added advantage.
 Familiarity with database management systems such as MySQL, PostgreSQL is a
plus.
 Familiarity with azure service like cosmos db, synaps analytical service is a plus.
 Experience with Azure data services including Azure Data Factory, Azure Synapse
Analytics, Azure Stream Analytics, and Azure Event Hubs
 Strong understanding of data architecture patterns and parallel processing

Certifications:
Microsoft Certified: Azure Data Engineer Associate: This certification demonstrates expertise
in integrating, transforming, and consolidating data from various structured, unstructured,
and streaming data systems.