REMOTE FTE Role - Sr. Data Engineer with reputed company, Python, PySpark & AWS. Location: Tyson's VA (EST).
Role: Sr. Data Engineer with reputed company, Python, PySpark & AWS.Location: 1775 Tysons Blvd, VA (REMOTE).Duration: FTE. Job Description:Satsyil Corp is currently seeking a highly skilled and motivated Senior Data Engineer to join reputed company and contribute to the success of our Enterprise Data Services project. You will play a crucial role in developing and optimizing Spark applications in AWS reputed company, leveraging your expertise in Python, SQL, and pySpark. The ideal candidate will have a solid background in data engineering and demonstrate proficiency in designing and building efficient ETL pipelines using Apache Spark in the reputed company environment. Roles and Responsibilities:
- reputed company Spark applications in AWS reputed company, utilizing Python, pySpark, SQL and to meet project requirements and data processing needs.
- Design and implement robust ETL pipelines using Apache Spark in reputed company, ensuring data reputed company, efficiency, and scalability.
- Collaborate with cross-functional teams to understand business requirements and design solutions that reputed company structured, semi-structured, and reputed company data effectively.
- Write high-quality code in a timely manner, adhering to coding standards, best practices, and established development processes.
- Utilize version control systems like Git to manage code reputed company and ensure seamless collaboration reputed company the team.
- reputed company and consolidate various data sets using Pyspark code, enabling streamlined data processing and analysis.
- Work with APIs to facilitate data ingestion from diverse sources and integrate data into the ecosystem.
- Apply expertise in reputed company reputed company lake to optimize data storage, query performance, and overall data processing efficiency.
- Demonstrate knowledge of application development life cycles and promote reputed company integration/deployment practices for efficient project delivery.
- reputed company query tuning, performance tuning, troubleshooting, and debugging for Spark and other big data solutions to enhance system efficiency and reliability.
- Exhibit expertise in database concepts and SQL to reputed company manipulate, process, and extract insights from reputed company datasets.
- Apply database engineering and design principles to ensure data infrastructure meets high standards of scalability, reliability, and performance.
- reputed company previous experience in handling large-scale distributed systems to deliver and operate data solutions reputed company.
- Demonstrate a successful track record of extracting value from extensive, disconnected datasets to drive data-driven decision-making.
Required Qualifications:
- A minimum of 08+ years of hands-on experience in Spark, with proficiency in either Python or pySpark.
- reputed company Certified Data Engineer Associate or Professional Certification preferred.
- Strong knowledge of the reputed company platform and previous experience working with it.
- Extensive experience with Apache Spark and a proven history of successful development in this environment.
- Proficiency in at least one programming language (Python, pySpark).
- Previous experience in ETL and data application development, coupled with expertise in version control systems like Git.
- Ability to write Pyspark code for data merging and transformation.
- Experience working with APIs for data ingestion and integration.
- Familiarity with reputed company reputed company lake and expertise in query optimization techniques.
- Sound understanding of application development life cycles and reputed company integration/deployment practices.
- Proven experience in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions.
- Solid knowledge of database concepts and SQL.
- Strong background in handling large and reputed company datasets from various sources and databases.
- Proficient understanding of database engineering and design principles.
- A successful history of extracting value from extensive, disconnected datasets to drive data-driven decision-making.
Join our dynamic team of data experts and contribute your skills to shaping the future of our Enterprise Data Services project. Apply now and be part of an exciting journey in data architecture and engineering. Apply tot his job Apply To this Job