Data Engineer — Databricks
Overview
We're looking for a Data Engineer — Databricks. Headquartered in Los Angeles, California, Right Balance provides top-tier technology talent for innovative companies in the US. We’re in the top 50 companies to watch in LA.
Client Engagement Details
In a rapidly evolving world of interactive entertainment, this company positions itself not as a game creator—but as the engine that empowers creators. Think of them as the behind‑the‑scenes partner who enables studios, publishers, and producers to move faster, smarter, and at scale.
Their target clients are game publishers, developers, and producers who have big visions but need help making those visions reliable, viable, and financially efficient. They’re not selling games—they’re selling enablement: future‑proofed operations, leaner infrastructure, richer data, and immersive innovation.
Our client is seeking a hands-on Data Architect with Data Warehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line.
This role will involve building from the ground up—architecting scalable pipelines, optimizing lakehouse performance, and integrating seamlessly with diverse real-time and batch data sources across AWS.
The ideal candidate is passionate about data architecture, thrives in fast-moving environments, and has a proven track record of setting up high-performance lakehouse platforms on Databricks with a strong foundation in data warehousing principles.
Key Responsibilities:
- Design and deploy a new Databricks Lakehouse instance tailored to the client’s product-level data needs.
- Architect and implement robust data ingestion pipelines using Spark (PySpark/Scala) and Delta Lake.
- Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability.
- Define data models, optimize query performance, and establish warehouse governance best practices.
- Collaborate cross-functionally with product teams, data scientists, and DevOps tostreamline data workflows.
- Maintain CI/CD, preferably DBX for data pipelines using GitOps and Infrastructure-as-Code.
- Monitor data jobs and resolve performance bottlenecks or failures across environments.
Length: 1+ Year. Client: Gaming Giant. Availability: Full-time.
What’s in it for you
- Learn and evolve your skills using the latest and greatest technology tools in a rapidly growing company.
- Learn from the best people around you. We constantly challenge the status quo and invent new ways of building a great product.
- 100% remote. Work anywhere, whether it is remotely in the comfort of your home, in a shared co-working space, in an RV on the beach, or while being a nomad in another country.
- Work on challenging problems, innovate, and positively impact many people's lives while having fun doing it.
Required Qualifications
- Upper-intermediate to fluent speaking and writing English. Able to have a real-time conversation.
- 4+ years of full-time hands-on Databricks experience.
- 4+ years of full-time hands-on PySpark/SQL experience.
- 4+ years of full-time hands-on AWS (Lambda, Glue, Redshift, Anthena, etc) experience.
- 3+ years of full-time hands-on Snowflake experience.
- 3+ years of full-time hands-on CloudWatch/Datadog/New Relic experience.
- 2+ years of full-time hands-on DBX/Terraform/GitHub/Azure DevOps experience.
- IAM and VPC configuration knowledge for secure cloud integrations.
- Experience setting up lakehouse design patterns for mixed workloads.
Nice to haves
- Experience supporting gaming or real-time analytics workloads.
- Familiarity with Airflow, Kafka, or EventBridge.
- Exposure to data privacy and compliance practices (GDPR, CCPA).
- Bachelor’s degree in Computer Science or equivalent demonstrated ability.
Frequently Asked Questions
What are your typical clients?
The majority of our clients are venture-backed startups at the growth stage. Usually, at this stage, the company already achieved a product-market fit and is looking to expand rapidly. That’s where we bring the best engineering practices, strong architecture, the latest technologies, and consistent processes to help companies scale.
What is the length of your engagements?
Most of our long-term full-time engagements last multiple years. It allows you to evolve your career with the client company taking on more responsibilities.
What’s your company size?
The Right Balance team is 55+ engineers going to 75+ by the end of the year. The current client size team is 150+ people. The timing is great to be a part of a rapidly growing team making meaningful contributions.
What happens if the engagement is completed?
Most of our engagements are long-term in nature. That said, if the current engagement is ramping down, we’ll present you with more long-term opportunities to transition into.
What are your core values?
Client First: we only win when our clients win. We treat client challenges as our own.
Ownership: we embrace responsibility, taking on challenges, getting them to completion, and enjoying getting things done.
Quality: we’re passionate about achieving quality outcomes by applying meticulous attention to detail.