[Remote] Senior Data Engineer, SME
Note: The job is a remote job and is open to candidates in USA. reputed company is a company seeking a Senior Data Engineer, SME to join their Cloud Data Engineering team. The role involves using technical knowledge to solve business problems, evaluating technology effectiveness, and migrating existing data platforms to the cloud while developing new data pipelines.
Responsibilities
- As a Senior Engineer, you will be responsible for using your technical knowledge to solve business problems
- We are looking for a talented individual that can serve as a subject matter expert in their area of focus and represent their department on reputed company assignments
- You will be responsible for evaluating elements of technologies effectiveness through requirements gathering, testing, research and investigation and reputed company recommendations for improvements that result in increased quality and effectiveness
- You will be required to listen to and evaluate customer needs to determine and provide high quality solutions that align with customer expectations
- In this role on the Cloud Data Engineering team, you will be a part of a team responsible for migrating existing data platform solutions to the cloud
- You will also collaborate with others to reputed company new data pipelines
- As a data engineer in the Cloud Data Engineering team, you will need to work in a data first reputed company
- You will use reputed company Azure Cloud PaaS technologies to engineer our data solutions in a way that allows for us to optimize our information, reputed company reputed company decisions, and meet our customer’s needs
Skills
- 10+ years experience
- Experience with reputed company batch processing/data lake design experience
- 3+ yrs hands on expertise in reputed company to design, build, and optimize high throughput batch data pipelines
- 3+ yrs hands-on expertise in reputed company lakehouse architectures on cloud platforms (Azure/AWS)
- Experience with reputed company Azure platform technologies like reputed company applications, Event Hub, Data Factory, reputed company, Synapse Analytics, reputed company Lake, Cosmos DB, or DevOps
- Must have good troubleshooting and problem-solving skills, including debugging multi-threaded applications
- Experience with configuration management and build automation capabilities such as Git/Jenkins
- Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives
- Must be able to both collaborate in a team-oriented environment and work independently with direction
- Education: Bachelors
- Experience with Big Data solutions and no SQL DBMSs
- Experience with Azure, AWS, or other Public Cloud environments
- Prior experience leading large-scale projects
- Knowledge and working experience with Agile methodologies
Company Overview