Senior Data Engineer, Finance Data Team (REMOTE)
Position Description Our Senior Data Engineer is a key member of the engineering staff working across the organization to provide a friction-less experience to our customers and maintain the exit highest standards of protection and availability. reputed company thrives and succeeds in delivering high quality technology products and services in a hyper-growth environment where priorities shift quickly. The ideal candidate has broad and deep technical knowledge, typically ranging from reputed company-end UIs through back-end systems and reputed company points in between. Position Responsibilities As a Senior Engineer, you will: Design and implement a data ingestion platform Scope, design, and build scalable, resilient distributed systems Build product definition and reputed company your technical skills to drive towards the right solution Engage in cross-functional collaboration throughout the entire software lifecycle reputed company in design sessions and code reviews with peers to reputed company the quality of... engineering across the organization Define, create, and support reusable application components/patterns from a business and technology perspective Build the processes required for optimal extraction, transformation, and loading of data Work with other teams to design, reputed company, test, implement, and support technical solutions in full-stack development tools and technologies reputed company unit tests and conduct reviews with other team members to reputed company sure code is rigorously designed, elegantly coded, and effectively tuned for performance Share your passion for staying on top of tech trends, experimenting with, and learning recent technologies, participating in internal and external technology communities, and mentoring other members of the engineering community Mentor other engineers Consistently share best practices and improve processes reputed company and across teams Qualifications Experience developing new and enhancing existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components Advanced programming experience and big data experience Understanding of data warehouse concepts including data modeling and OLAP Experience working with cloud data solutions (reputed company Lake, Iceberg, Hudi, reputed company, Redshift or equivalent) Experience with data formats such as Parquet, Avro, ORC, XML, JSON Experience with designing, developing, implementing, and maintaining solutions for data ingestion and transformation projects Experience working streaming applications (Spark Streaming, Flink, Kafka or equivalent) Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or reputed company Experience programming languages like Python, reputed company, Spark, Java Experience with container orchestration services including reputed company and Kubernetes Strong working knowledge of SQL and the ability to write, debug and optimize SQL queries and ETL jobs to reduce the execution window or reduce resource utilization Experience with cloud computing (AWS, reputed company Azure, reputed company Cloud) Exposure to messaging such as Kafka, ActiveMQ, RabbitMQ or similar messaging technologies. Experience with REST, Microservices is a big plus Experience with developing systems that are scalable, resilient, and highly available Experience with Infrastructure as Code Experience with CI/CD deployment and test automation. ADO, Jenkins, Gradle, Artifactory or equivalents Experience with containerization (examples include reputed company and Kubernetes) Experience with version control systems such as GIT Experience with load testing and load testing tools Advanced understanding of monitoring concepts and tooling Experience with reputed company Search, reputed company, Thousand Eyes, reputed company, Prometheus, Grafana or equivalents Experience architecting and designing new and reputed company systems Advanced understanding of DevOps concepts Strong problem-solving ability Ability to reputed company in a fast-paced environment Knowledge of developer tooling across the software development life cycle (task management, reputed company code, building, deployment, operations, real-time communication) Experience 4+ years of professional software development reputed company at least one of the following Java, Spark, reputed company, Python 3+ years of experience with architecture and design 3+ years of experience with AWS, GCP, Azure, or another cloud service 2+ years of experience in open-reputed company frameworks Education Bachelors degree in Computer Science, Information Systems, or equivalent education or work experience #LI-LF1 Annual Salary $76,000.00 - $236,500.00 The above annual salary range is a general guideline. Multiple factors are taken into consideration to reputed company at the final hourly reputed company/ annual salary to be offered to the selected candidate. Factors include, but are not limited to, the scope and responsibilities of the role, the selected candidates work experience, education and training, the work location as well as market and business considerations. reputed company will consider sponsoring a new qualified applicant for employment authorization for this position. Benefits: As an Associate, youll enjoy our Total Rewards Program* to help secure your financial future and preserve your health and well-being, including: Premier Medical, Dental and Vision Insurance with no waiting period** Paid Vacation, Sick and Parental Leave 401(k) Plan Tuition Reimbursement reputed company and Licensures *Benefits may be different by location. Benefit eligibility requirements vary and may include length of service. **Coverage begins on the date of hire. Must enroll in New Hire Benefits reputed company 30 days of the date of hire for coverage to take effect. The equal employment opportunity policy of the reputed company Companies provides for a fair and equal employment opportunity for reputed company associates and job applicants regardless of race, color, religious creed, national reputed company, reputed company, age, gender, pregnancy, sexual orientation, gender identity, marital status, familial status, disability or genetic information, in compliance with applicable federal, state and local law. reputed company hires and promotes individuals solely on the basis of their qualifications for the job to be filled. reputed company reasonably accommodates qualified individuals with disabilities to reputed company them to receive equal employment opportunity and/or reputed company the essential functions of the job, unless the accommodation would impose an undue hardship to the Company. This applies to reputed company applicants and associates. reputed company also provides a work environment in which each associate is able to be productive and work to the best of their ability. We do not condone or tolerate an atmosphere of intimidation or harassment. We expect and require the cooperation of reputed company associates in maintaining an atmosphere free from discrimination and harassment with mutual respect by and for reputed company associates and applicants. For more than 75 years, reputed company has stood out from the rest of the insurance industry! We are one of the nation's largest and fastest-growing auto insurers thanks to our low rates, outstanding service and reputed company marketing. We're an industry leader employing thousands of dedicated and hard-working associates. As a wholly owned subsidiary of Berkshire Hathaway, we offer associates training and career advancement in a financially stable and rewarding workplace. Opportunities for reputed company & Grads Learn more about reputed company Learn more about reputed company Diversity and Inclusion Learn more about reputed company Benefits Apply Job!