Data Architect

Role- Databricks Tech SME

Rate- £650/day (inside IR35)

Location- Leeds (3 days a week)

Contract- 6 months with extension

Role:

community’s most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions. Here are the details on this position. As a Databricks Tech SME, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community’s most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions. Here are the details on this position.

Mandatory Skills:

Deploy, support, and administer the Databricks in the Cloud including but not limited to:

Memory Management

Handle scheduling queues & messages

Performance Management

Supervise cluster health checks

Regular back up & recovery

Node commissioning & decommissioning

Code deployments

Server log analysis

Manage tenants including workspace creation, user management, cloud resources, and account usage monitoring

Advise on architecture and scaling for Databricks environments

Collect user requirements and set up data storage, notebooks, and compute to fulfil business use cases

Serve as a point of contact for technical issues in the environment

Monitor usage, report on cost management, and participate in cost planning

What we're looking for:

3+ years’ experience in data administration, from setting up the Databricks environment to successfully administering it

Proven experience as the Databricks account owner, managing workspaces, audit logs, and high-level usage monitoring

Experience managing cluster and jobs configuration options

Experience with GCP or AWS set up of Databricks

Proven ability to meet established service levels, availability, performance, data privacy, and security guidelines is necessary

Be able to Install, troubleshoot, integrate with Identity Access Management for Databricks

Good knowledge on GCP and Kubernetes - focus of this is around ensuring HSBC controls are adhered to as part of the deployment of Dev. Be able to create Blueprint for Production including billing/support model, security, naming conventions etc.

Terraform knowledge

Write up required:

How to set up Databricks on Cloud

What considerations should be taken on migrating workloads to Databricks?

Has he set up Databricks control planes?

Describe consideration / aspects between setting up data bricks for a POC on a dev environment as opposed to a Production environment