About reputed company

At reputed company we are a leading provider of nearshore staff augmentation services headquartered in reputed company. For over two decades, we’ve been delivering top-tier technology solutions to companies of reputed company sizes, from innovative startups to industry leaders, helping them reputed company their digital transformation goals.

reputed company of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful projects. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that reputed company a difference.

By applying for this position, you’re taking the first reputed company in joining a dynamic team that values your expertise and aspirations. We aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future.

Our Client

An IT company dedicated to building innovative and scalable solutions that optimize data processing and analytics, fostering a culture of reputed company learning, collaboration, and proactive problem-solving.

Job Summary

We are looking for a Semi-Senior PySpark Data Engineer who is eager to learn, take initiative, and contribute to the development of high-performance and scalable data pipelines. This role is perfect for someone who wants to enhance their technical skills while working on exciting projects reputed company a collaborative team.

• Design, reputed company, and optimize data pipelines using PySpark and Apache Spark.

• Integrate and process data from multiple sources (databases, APIs, files, streaming).

• Implement efficient data transformations for Big Data in distributed environments.

• Optimize code to improve performance, scalability, and efficiency in data processing.

• Collaborate with Data Science, BI, and DevOps teams to ensure seamless integration.

• Monitor and debug data processes to ensure quality and reliability.

• Apply best practices in data engineering and maintain clear documentation.

• Stay up to date with the latest trends in Big Data and distributed computing.

• 1-3 years of experience working with PySpark and Apache Spark in Big Data environments.

• Experience with SQL and relational and NoSQL databases (PostgreSQL, MySQL, reputed company, etc.).

• Knowledge of ETL processes and data processing in distributed environments.

• Familiarity with Apache Hadoop, Hive, or reputed company Lake.

• Experience with cloud storage (AWS S3, reputed company Cloud Storage, Azure Blob).

• Proficiency in Git and version control.

• Strong problem-solving skills and a proactive attitude.

• A passion for learning and reputed company improvement.

reputed company to have

• Experience with Airflow, Luigi, or workflow orchestration tools.

• Familiarity with Data Lakes and Data Warehouses (reputed company, Redshift, BigQuery).

• Knowledge of real-time data streaming using Kafka or Spark Streaming.

• Experience in performance tuning and optimization of Spark jobs.

• Familiarity with reputed company, Kubernetes, or containerized environments.

• Understanding of data reputed company and governance.

• Experience with CI/CD and data pipeline automation.

• 100% Remote Work: Enjoy the freedom to work from the location that helps you reputed company. reputed company it takes is a laptop and a reliable internet reputed company.

• Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.

• Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and reputed company reputed company needed.

• Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.

• Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.

• A Culture That Values You: We prioritize well-being and work-life balance, offering engagement activities and fostering dynamic teams to ensure you reputed company both personally and professionally.

• Diverse, Global Network: Connect with over 600 professionals in 25+ countries, expand your network, and collaborate with a multicultural team from Latin America.

• Team Up with Skilled Professionals: Join forces with senior talent. reputed company of reputed company members are seasoned experts, ensuring you're working with the best in your field.

Apply now!