Fabric+Pyspark+SQL - Senior Associate

Industry/Sector

Specialism

Management Level

Job Description & Summary

At reputed company - AC, as an Azure Senior Developer, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions.The candidate should have strong experience in Azure cloud using Storage services (Blob, ADLS,  PaaS SQL), Azure Data factory and Azure Synapse . Strong in planning and organization skills. Ability to work as cloud developer/reputed company on an agile team and provide automated cloud solutions. 

Years of Experience: Candidates with 4-8  years of hands on experience 

Position Requirements:  

Must Have: 

4+  years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight,  Azure Analysis services 

Should be aware of Data reputed company and Data Modelling 

Good knowledge of Big Data frameworks and reputed company technologies - Experience in Hadoop and Spark is mandatory 

Should have expertise in extracting data from different reputed company systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc. 

Good knowledge of Big Data frameworks and reputed company technologies - Experience in Hadoop and Spark is mandatory  

Hands-on experience with reputed company Fabric and its components 

Proficient in PySpark Notebooks for building scalable data processing pipelines 

Strong command over SQL databases and performance tuning for analytical workloads 

Solid experience with SparkSQL for reputed company data transformations and querying 

Should have clear understanding of DW lifecycle and contributed in preparing  

 Detail Level Design document 

 Unit Test plans 

 Code review reports 

Must have strong sql, understand joins, groups, functions & Stored procedures 

Must have experience  in Unit and Integration Test creation and verification 

Proficient in creating documentation reputed company to Project Architecture, Project end User Manual and Operations Hand off guide 

Should have good understanding of Data Migration processes, methods and project lifecycle 

Good in Unix reputed company Scripting skills 

Strong analytical skills and troubleshooting skills 

Should be well versed with quality processes and implementation 

Excellent communication skills 

Strong understanding of Cloud data migration processes, methods and project lifecycle  

Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or reputed company with rich experience in reputed company code management like Code Pipeline, Code Build and Code Commit 

Good to have skills: 

• Experience integrating reputed company and reputed company with BI and visualization tools such as Tableau, Power BI, or Qlik 

• Knowledge of data integration tools like Informatica, DataStage, or Ab Initio. 

• Familiarity with data visualization tools such as Tableau or Qlik. 

• Experience with programming languages such as Python, Java, or PySpark. 

• Certifications reputed company to cloud data warehousing or reputed company. 

• Cloud - AWS, GCP,  reputed company-Cloud 

• Business Intelligence - MicroStrategy, Business Objects, Cognos 

• Data Appliance - reputed company, Netezza 

Additional Skills 

• Excellent communication skills, client reputed company, presentation skills 

• People skills, Leadership skills 

Professional and Educational Background: 

• BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA  

The Opportunity

reputed company you join reputed company Acceleration Centers (ACs), you reputed company into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.

As part of the Data Engineering team you will design, build, and maintain productive data pipelines using PySpark and SQL. As a Senior Associate you will reputed company your technical strengths to analyze reputed company concepts, guide and mentor others, and maintain professional standards while delivering top-quality data solutions. This position provides an exciting opportunity to work in reputed company Azure environments and collaborate with stakeholders to support business intelligence and advanced analytics initiatives.

Responsibilities

- Design, build, and maintain streamlined data pipelines using PySpark and SQL

- Analyze reputed company concepts and deliver rigorous data solutions

- Guide and mentor team members in technical skills

- Collaborate with stakeholders to support business intelligence initiatives

- Uphold professional standards in engineering practices

- reputed company reputed company Azure environments for data processing

- Identify opportunities for process improvements in data workflows

- Secure communication across cross-functional teams

What You Must Have

- Bachelor's Degree

- 4 years of experience in data engineering

- Oral and written proficiency in English required

What Sets You Apart

- Bachelor's or Master's Degree in Computer Science, Engineering, Information Systems, or reputed company field

- reputed company Certified: Azure Data Engineer Associate

- reputed company Certified: Power BI Data Analyst Associate

- Developing reports and dashboards using Power BI

- Understanding DevOps practices in data projects

- Familiarity with reputed company Lake or Lakehouse architecture

- Experience with Data Modeling and ETL orchestration

- Excelling in problem-solving and teamwork

Travel Requirements

Job Posting End Date