Job Description

Inviting applications for the role of Senior Principal Consultant- Databricks Platform Architect!

We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data warehousing, and big data technologies. They will work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.

Responsibilities

• Architect and design solutions to meet functional and non-functional requirements.
• Lead the design, implementation, and optimization of our Databricks platform.
• Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
• Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
• Collaborate with other teams to ensure that our Databricks platform is integrated with our other systems and technologies.
• Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
• Provide guidance and support to our data engineering team on Databricks-related issues.
• Create and review architecture and solution design artifacts.
• Evangelize re-use through the implementation of shared assets.
• Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
• Proactively guide engineering methodologies, standards, and leading practices.
• Guidance of engineering staff and reviews of as-built configurations during the construction phase.
• Provide insight and direction on roles and responsibilities required for solution operations.
• Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
• Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
• Demonstrate strong analytical and technical problem-solving skills.
• Ability to analyze and operate at various levels of abstraction.
• Ability to balance what is strategically right with what is practically realistic.
• Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
• Supporting and developing our people, including learning & development, certification & career development plans
• Providing technical governance and oversight for platform design and implementation
• Should have technical foresight to understand new technology and advancement.
• Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance
• Should have Technical Experience in Azure, AWS & GCP Cloud Data Engineering services and solutions.

Qualifications we seek in you!

Minimum qualifications

• Proven experience, as a Data Architect, Data Solutions Architect, or similar role in a consulting environment.
• Hands-on Experience to design platforms and build Databricks-based solution on cloud platform (Azure, AWS).
• Excellent technical architecture skills, enabling the creation of future-proof, complex global Platform solutions on Databricks.
• Excellent interpersonal communication and organizational skills are required to operate as a leading member of global, distributed teams that deliver quality services and solutions.
• Ability to rapidly gain knowledge of the organizational structure of the firm to facilitate work with groups outside of the immediate technical team.
• Knowledge and experience in IT methodologies and life cycles that will be used.
• Familiar with solution implementation/management, service/operations management, etc.
• Leadership skills – ability to inspire others and persuade.
• Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
• Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
• Experience in a Platform architecture role using service and hosting solutions such as private/public cloud IaaS, PaaS, and SaaS platforms.
• Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
• Must have strong hands-on experience on various cloud services like ADF/Lambda, ADLS/S3, Security, Monitoring, Governance & Compliance.
• Must have experience to design platform on Databricks.
• hands-on Experience to design and build Databricks based solution on any cloud platform.
• hands-on experience to design and build solution powered by DBT models and integrate with databricks.
• Must be very good designing End-to-End solution on cloud platform.
• Must have good knowledge of Data Engineering concept and related services of cloud.
• Must have good experience in Python and Spark.
• Must have good experience in setting up development best practices.
• Good to have knowledge of docker and Kubernetes.
• Experience with claims-based authentication (SAML/OAuth/OIDC), MFA, RBAC, SSO etc.
• Knowledge of cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.
• Experience building and supporting mission-critical technology components with DR capabilities.
• Experience with multi-tier system and service design and development for large enterprises
• Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.
• Exposure to infrastructure and application security technologies and approaches
• Familiarity with requirements gathering techniques.

“Los Angeles, California based candidates are not eligible for this role. < Atlanta, GA,/ Houston, TX > area candidates are eligible for this role only.”

Job Tags

Similar Jobs