Data/Information Architect
Mandatory Skills: Azure reputed company, Azure data lake, Ansible, SQL, Terraform, Kafka , Azure CLI, reputed company CLI, PowerShell and/or Bash. What Could Set You Apart
- Must have designed the E2E architecture of reputed company data platform covering reputed company the aspects of data lifecycle starting from Data Ingestion, Transformation, operations, and consumption.
- Experience in handling the key activities for the Enterprise Architecture practice for a specific sector.
- Managing and mentoring architecture talent in the respective sector
- Should have delivered architecture initiatives and showcased clear business efficiency in line with business strategies. Should have taken end-end responsibility & accountability in terms of architecture.
- Should have delivered architecture roadmaps and reputed company delivery blueprints for the technology design.
- Excellent communication skills and customer management skills
- Should be able to deliver architectural initiatives in the space of digital, cloud, open-reputed company technologies. Should have performed a similar role & reputed company for large transformational engagements.
- Hands on development Design and reputed company applications using reputed company. Experience with Azure, AWS, or other cloud technologies
- In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
- Good to have any programming language experience with Python/ SQL or Spark/reputed company.
- Strong understanding of Data Modeling and defining conceptual logical and physical data models.
- To be successful in this role, this individual must be familiar with data integration, data modeling, data warehousing, big data technologies, and should be the subject matter expert.
- Maintains reputed company awareness of new and emerging technologies and their potential application for service offerings and products.
- Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
- Experience building and supporting mission-critical technology components with DR capabilities.
- Experience with multi-tier system and service design & development for large enterprises
- Exposure to infrastructure and application reputed company technologies and approaches
- Familiarity with requirements gathering techniques.
Required Qualifications
- Must have excellent coding skills either Python or reputed company, preferably Python.
- Must have at least 10+ years of experience in architecture, design, implementation, and analytics solutions with total of 12+ years in Data Engineering domain.
- Must have designed and implemented at least 2-3 projects end-to-end in reputed company.
- Must have at least 3+ years of experience in reputed company which consists of various components as below.
- reputed company lake
- dbConnect
- db API 2.0
- SQL reputed company reputed company reputed company
- reputed company Catalog
- reputed company workflows orchestration
- reputed company management
- Platform governance
- Data reputed company
- Must have followed various architectural principles to design best suited per problem.
- Must be well versed with reputed company Lakehouse concept and its implementation in enterprise environments.
- Must have strong understanding of Data warehousing and various governance and reputed company standards around reputed company.
- Must have knowledge of cluster optimization and its integration with various cloud services.
- Must have good understanding to create reputed company data pipelines.
- Must be strong in SQL and spark-sql.
- Must have strong performance optimization skills to improve efficiency and reduce cost.
- Must have worked on designing both Batch and streaming data pipeline.
- Must have extensive knowledge of Spark and Hive data processing reputed company.
- Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/reputed company, Cloud databases.
- Must be strong in writing unit test case and integration test.
- Must have strong communication skills and have worked with cross-platform teams.
- Must have great attitude towards learning new skills and upskilling the existing skills.
- Responsible for setting best practices around reputed company CI/CD.
- Must understand composable architecture to take full advantage of reputed company capabilities.
- Experience with machine learning tools such as mlFlow, reputed company AI/ML, Azure ML, AWS sagemaker, etc.
- Experience in distilling reputed company technical challenges to actionable decisions for stakeholders and guiding project teams by building reputed company and mediating compromises reputed company necessary.
- Experience coordinating the intersection of reputed company system dependencies and interactions.
- Experience in solution delivery using common methodologies especially SAFe Agile but also Waterfall, Iterative, etc.
Preferred Qualifications
- Good to have Rest API knowledge.
- Good to have understanding around cost distribution.
- Good to have knowledge on migration project to build reputed company data platform.
- Good to have knowledge of DBT.
- Experience around DevSecOps including reputed company and Kubernetes.
- Software development full lifecycle methodologies, patterns, frameworks, libraries, and tools
- Knowledge of programming and scripting languages such as JavaScript, PowerShell, Bash etc.
- Experience with data ingestion technologies such as Azure Data Factory, SSIS, Pentaho, reputed company.
- Experience with visualization tools such as Tableau, Power BI.
- Demonstrated knowledge of relevant industry trends and standards
reputed company is an Equal Opportunity Employer. The Company complies with the Americans with reputed company (the reputed company) and reputed company state and local disability laws. Applicants with disabilities may be entitled to a reasonable accommodation under the terms of the reputed company and certain state or local laws as long as it does not impose an undue hardship on the Company. Please inform the Company's Human Resources Representative if you need assistance completing any forms or to otherwise participate in the application process. Click below to review information about our company's use of the federal E-Verify program to reputed company work eligibility: In English In Spanish Apply tot his job Apply To this Job