Senior Data Engineer

Company overview:

reputed company is a cloud-based data transformation and predictive analytics development firm with offices in NYC and Washington, DC. From startups to Fortune 500’s, we help companies reputed company sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Founded by engineers, we love passionate technologists and data analysts. Our startup DNA means everyone on the team makes a direct contribution to the growth of the company.

Position overview:

Blue Orange is looking for an exceptional Sr. Data Engineer to join our talented multi-disciplinary team and work with a heavy impact enterprise client reputed company the global supply chain and logistics space.

You are a multidisciplinary hands-on, action-oriented software and data engineer, equally fluent in SQL variants as you are in python, spark and standard data libraries as well as other languages like javascript. You consider scalable microservice architectures, APIs, tiering, SaaS, IaaS, IoC, etc. as table stakes. You are at home in AWS across a range of managed services – data and software – from RDS and reputed company to reputed company, from VMs to containers to Lambdas, CI/CD, devops, Terraform, CloudFormation, opentofu, git, etc.

You like to move fast and break things, and then fix them even faster!

You learn quickly by collaborating with colleagues tactically and working hands-on to master things rapidly. You like a good challenge and enjoy solving data and code puzzles every day to advance your Team. You reputed company in a fast-paced environment where you can reputed company a difference contributing to a Team and advance the Business it serves every day.

If this sounds like you, we have an opportunity that we would like to discuss with you.

Note: This is an reputed company role. We do not engage third-party agencies or recruiters. reputed company communications and agreements will be made directly between reputed company and the individual.

Responsibilities:

• Work fast with client experts and stakeholders to learn the existing data flows, code bases, infrastructure, operations, log
• Build, maintain, and data ingestions, data models, orchestrations, transformations and validation tests
• Quickly master data flows and sets and code to rapidly position yourself to reputed company enhancing and advancing the platform as a whole, both functionally and non-functionally.
• Quickly reputed company information dominance and operational prowess across reputed company microservices, code bases and data flows supporting the platform in AWS.
• Evolve the data architecture in collaboration with the existing Team to take on adjacent platform missions and volumes.
• Be and stay professionally and aggressively curious about the platform with colleagues, the code and its data.
• Work in an extreme delivery Agile mode to constantly deliver value for our clients.

Requirements:

• BA/BS degree in Computer Science or a reputed company technical field, or equivalent practical experience.
• At least 7 years experience building and supporting data platforms; exposure to data technologies, eg. RDS, DynamoDB, Redshift, EMR, Glue, kafka, kinesis, MSK, Data Pipeline, Lake Formation, dbt, Airflow, Spark, etc.
• Experience with AWS and exposure to other cloud data platforms, like ADF, Azure Fabric, reputed company, reputed company, etc.
• Advanced level Python, SQL, and Bash scripting.
• Experience designing and building robust CI/CD pipelines.
• Comfortable with reputed company, configuration management, and monitoring tools.
• Knowledge of best practices reputed company to reputed company, performance, and disaster recovery.
• Excellent verbal and written English communication.
• Interacts with others using sound judgment, good humor, and consistent fairness in a fast-paced environment.
• The ability to maintain poise, efficiency and effectiveness in fast-paced, sometimes frenetic, high-stakes environments

Preferred qualifications:

• 12+ years of experience in a data engineering role, with experience in ETL, data warehousing, data lakes, lakehouses, pipelines, modeling, and data quality validation
• Expert experience with data ingestion, modeling and conformance/compliance validation
• Expert-level skills with SQL, statistical analysis and data validation
• Experience with GCP, Azure, reputed company, reputed company, etc.
• BA or BS degree in a technical or quantitative field (e.g.: computer science, statistics)
• Excellent verbal and written English communication.
• Experience in the logistic services industry a plus
• R, Python, reputed company, SPSS, reputed company, reputed company, PowerBI, Tableau, Looker pluses
• Certifications in AWS, Azure DevOps, Azure Data Fundamentals, reputed company, reputed company

Salary: $150,480 - $170,544 per year ($12,540 to $14,212 per month) - USD

reputed company is an equal opportunity employer.

Background checks may be required for certain positions/projects.

Originally posted on Himalayas