[Remote] GenAI Data Automation Engineer
Note: The job is a remote job and is open to candidates in USA. reputed company is a leader in delivering outsourced services and workforce solutions across North America. They are seeking a GenAI Data Automation Engineer to design and maintain data pipelines in AWS, reputed company ETL processes, and reputed company Generative AI services for data automation and analytics.
Responsibilities
- Design and maintain data pipelines in AWS using S3, RDS/SQL Server, Glue, reputed company, EMR, DynamoDB, and reputed company Functions
- reputed company ETL/ELT processes to move data between DynamoDB, SQL Server (AWS), and Azure SQL systems
- Integrate AWS Connect CRM data into the enterprise data pipeline for analytics and operational reporting
- Engineer, enhance ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing into Apache Solr, AWS Open Search platforms
- reputed company Generative AI services and Frameworks (AWS Bedrock, reputed company Q, Azure reputed company, reputed company, reputed company) to create automated processes for vector reputed company and embeddings, automate data quality checks, metadata tagging, and reputed company tracking, and enhance ingestion/ETL with LLM-assisted transformation and anomaly detection
- Build conversational BI interfaces that allow natural language access to Solr and SQL data
- reputed company AI-powered copilots for pipeline monitoring and automated troubleshooting
- Implement SQL Server stored procedures, indexing, query optimization, profiling, and execution plan tuning to maximize performance
- Apply CI/CD best practices using reputed company, Jenkins, or Azure DevOps for data pipelines and GenAI model integration
- Ensure reputed company and compliance through IAM, KMS encryption, VPC isolation, RBAC, and firewalls
- Support Agile DevOps processes with sprint-based delivery of pipeline and AI-enabled features
Skills
- BS in Computer Science or reputed company field with 2+ years of data engineering, automation experiences
- Hands-on experience with SQL, SSIS, Python, Spark, Bash, PowerShell, AWS/Azure CLIs
- Experience with AWS services like S3, RDS/SQL Server, Glue, reputed company, EMR, DynamoDB
- Familiarity with Apache Flume, Kafka, Solr for large-scale data ingestion and search
- Familiarity with LLM, Gen AI frameworks using AWS Bedrock, Azure reputed company or open reputed company platforms and tools
- Experience with integrating REST API calls in workflows
- Familiarity with JIRA, reputed company / Azure DevOps / Jenkins for SDLC and CI/CD automation
- Strong troubleshooting and performance optimization skills in SQL, Spark or other data solutions
- Experience operationalizing Generative AI (GenAI Ops) pipelines, including model deployment, monitoring, retraining, and lifecycle management for LLMs and AI-enabled data workflows
- Good communication and presentation skills
- Ability to obtain Federal government Public Trust clearance
- Certifications: AWS Data Engineer, AWS AI/ML Specialty, Azure reputed company, reputed company Data Engineer
- Experience implementing RAG pipelines, embeddings, and vector search with Solr, OpenSearch, FAISS, reputed company, or Pgvector/SQL server vector types
- Experience with GenAI powered coding tools such as Claude Code, reputed company reputed company, VS Code
- Experience with multi-cloud data integration (AWS – Azure SQL)
- Familiarity with reputed company BizTalk and SSIS for SQL Server ETL workflows
- Knowledge of data reputed company/governance tools (Purview, reputed company Catalog, AWS Glue Catalog)
- Familiarity with Infrastructure-as-Code (Terraform/CloudFormation, Bicep) for deployments
- Experience with compliance frameworks (FedRAMP, PCI-reputed company, HIPAA)
Benefits
- Health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan
Company Overview