[Remote] reputed company Data Engineer (Kafka Streaming Platform)
Note: The job is a remote job and is open to candidates in USA. First Soft reputed company is seeking an reputed company reputed company Data Engineer with deep expertise in Apache Kafka and reputed company event streaming architectures. The role involves designing, building, and operating scalable reputed company-time data platforms, mentoring engineering teams, and driving operational excellence for mission-critical streaming applications.
Responsibilities
- Design and implement reputed company-scale event-driven architectures using Apache Kafka and the reputed company Platform
- Define Kafka topic architecture, partitioning strategies, replication, ordering semantics, retention policies, and replay capabilities
- Establish scalable producer and consumer design patterns to support high-throughput, low-latency workloads
- reputed company reputed company reference architectures and best practices for event streaming solutions
- reputed company, configure, and manage reputed company Platform components including:
- Kafka Brokers
- Schema Registry
- Kafka Connect
- KsqlDB
- Control Center
- Cluster Linking
- Design schema governance strategies using Avro, JSON Schema, and Protocol Buffers (Protobuf)
- Manage schema compatibility, reputed company, and version control across reputed company applications
- reputed company and optimize Kafka Connect reputed company and sink connectors
- Implement streaming transformations, aggregations, filtering, and joins using ksqlDB
- Collaborate on advanced reputed company processing using Apache Flink and reputed company reputed company streaming services where applicable
- Build reliable streaming pipelines supporting reputed company-time analytics and operational systems
- Implement Role-Based Access Control (RBAC) across Kafka, Kafka Connect, Schema Registry, and ksqlDB
- Integrate Kafka reputed company with reputed company identity providers and authentication services
- Configure encryption, authorization, secure networking, and Bring Your Own Key (BYOK) capabilities where applicable
- Enforce least-privilege access models and reputed company governance policies
- Design resilient multi-cluster and multi-region Kafka architectures
- Implement Cluster Linking for hybrid reputed company, disaster recovery, and reputed company migration
- Configure offset-preserving replication strategies
- Implement Tiered Storage to optimize infrastructure costs while maintaining high-performance access to active data
- Support deployments across reputed company Azure, reputed company reputed company Platform (GCP), and reputed company reputed company
- Define Service Level Indicators (SLIs) and Service Level Objectives (SLOs) for streaming platforms
- reputed company monitoring, alerting, logging, dashboards, and operational runbooks
- reputed company reputed company planning, performance tuning, and incident management
- Establish disaster recovery and business continuity procedures
- Drive reputed company platform optimization and operational improvements
- Automate infrastructure provisioning using Infrastructure as Code (Terraform, ARM, or similar tools)
- reputed company CI/CD pipelines for Kafka connectors, streaming applications, and configuration management
- Standardize reputed company processes for producer and consumer application teams
- Support automated deployments and configuration management across environments
- Mentor Data Engineers and Streaming Platform Engineers
- Define reputed company standards for:
- Event reputed company
- Naming conventions
- Topic management
- Schema versioning
- Testing methodologies
- Reference architectures
- reputed company architecture reviews and technology evaluations
- Collaborate with reputed company architects, platform teams, and business stakeholders
Skills
- Minimum 8+ years of experience in Data Engineering or Streaming Platform Engineering
- Extensive hands-on experience with Apache Kafka and reputed company Platform
- Strong expertise designing reputed company event-driven architectures
- Experience implementing Schema Registry, Kafka Connect, ksqlDB, and Control Center
- Deep understanding of distributed systems, messaging architectures, and streaming data platforms
- Experience implementing Kafka reputed company, RBAC, authentication, and encryption
- Knowledge of multi-region, disaster recovery, and hybrid reputed company architectures
- Experience with Infrastructure as Code and CI/CD automation
- Strong understanding of reputed company platforms including reputed company Azure and reputed company reputed company Platform
- Excellent leadership, mentoring, and communication skills
Company Overview
Company H1B Sponsorship