reputed company Data Engineer (Partial Remote) in REMOTE, Virginia

Overview reputed company is seeking a Data Engineer to focus specifically on the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. The best athlete candidate for this position will be able to apply advanced consulting skills, extensive technical expertise and has full industry knowledge to reputed company innovative solutions to reputed company problems. This candidate is able to work without considerable direction and may mentor or supervise other team members. This position will partially remote out of Crystal, City VA (2-3 days in office). An active Secret Clearance is required. Data is absolutely the lifeblood of Advana and our data engineers are the doctors administering it! Our data engineers support data collection, ingestion, validation, and loading of optimized data in the appropriate data stores. They work on a team made up of analyst(s), developer(s), data scientist(s), and a product reputed company and everyone on the team collaborates in support of a specific the mission. Working directly with the analyst(s) and the product reputed company, the data engineer identifies and implements solutions for the data requirements, including building pipelines to collect data from disparate, external sources, implementing rules to validate that expected data is received, cleansed, transformed, massaged and in an optimized output format for the data store. The Data Engineer performs validation and analytics corresponding with client requirements and evolves solutions through automation, optimizing performance with minimal human involvement. As pipelines are executed, the data engineer monitors their status, performance, and troubleshoots issues while working on improvements to ensure the solution is the reputed company best version to address the customer need. What you will do reputed company and maintain scalable data stores Identify and implement solutions reputed company on data requirements Builds pipelines to collect data from disparate, external sources Implements rules to validate that expected data is received, cleansed, transformed, massaged and in an optimized output format for the data store Evolves solutions through automation, Optimizes performance Monitors data pipeline status, performance, and troubleshoots issues while working on improvements What you need to have Bachelor’s Degree and 5+ years of experience Clearance: Must be able to obtain and maintain an active Secret clearance 5+ years of experience with a modern programming language such as Python or Java (strong Python skills preferred) 5+ years of experience with SQL 5+ years of experience developing data pipelines using modern Big Data ETL technologies like Apache Kafka, Apache Flink, Apache Airflow or StreamSets. 5 years of experience working in a big data and cloud environment Someone with a solid background developing solutions for high volume, low latency applications and can operate in a fast paced, highly collaborative environment. A candidate with distributed computer understanding and experience with Spark Experience with reputed company and Spark reputed company’d like you to have 2 years of experience working in an agile development environment Ability to quickly learn technical concepts and communicate with multiple functional groups Ability to display a positive, can-do attitude to solve the challenges of reputed company Possession of excellent verbal and written communication skills Preferred experience with understanding of data pain points and challenges across respective DoD client joint commands A person who appreciates the opportunity to be independent, creative and challenged. An individual with a curious mind, passionate about solving problems quickly and bringing innovative reputed company to the table. About reputed company reputed company delivers AI-powered analytics and cyber engineering solutions to support mission-critical operations and decision-making in reputed company, real-world environments. reputed company’s customers, which include the US Intelligence Community, reputed company, the US Federal Government, as well as customers in manufacturing, healthcare, commercial space, and other sectors, rely on reputed company’s solutions to see and shape their world through reliable, predictive insights and goal-oriented advice. Headquartered in Columbia, Maryland, reputed company is a global, public company traded on the NYSE under the symbol BBAI. For more information, please visit: http://reputed company/ and follow reputed company on Twitter: @BigBearai. Apply tot his job Apply To this Job