Data Engineer - Python
Overview
We're looking for a Data Engineer - Python. Headquartered in Los Angeles, California, Right Balance provides top-tier technology talent for innovative companies in the US. We’re in the top 50 companies to watch in LA.
Engagement Details
Our client is a global technology consultancy focused on designing and implementing secure, observable cloud architectures embracing an Everything as Code (EAC) approach so our clients can focus on their business goals. We can provide strategy, design, implementation, and follow-the-sun support. We also create custom software products when there are missing links in current solutions.
Their areas of expertise are data-intensive cloud applications supported by RDBMS and NoSQL solutions, CI/CD using DevOps and DevSecOps pipelines, total observability from client to application in the cloud, and hybrid architectures.
They are an AWS Advanced Partner and a Datadog Gold Partner and are proud to share their learnings with the technology community. They believe the difference between something good and something great is attention to detail.
The end client is a Technology company in Richmond, VA.
About the Role:
Join as a Data Developer and contribute to building and maintaining data solutions in AWS for one of our largest clients. You'll design, develop, test, and deploy new features, working with large datasets, Python, Spark, and various AWS services. Mentor others, lead projects, and impact our team's success.
We are looking for Experienced Data Engineers to help a large customer migrate legacy ETL jobs (currently Glue/Lambda/Snowflake for business systems) to their Airflow/Databricks standard.
Other Details:
- Location: Remote role (Latin America).
- Time Zone Preference - EST.
- Length: 6+ months.
What’s in it for you
- Learn and evolve your skills using the latest and greatest technology tools in a rapidly growing company.
- Learn from the best people around you. We constantly challenge the status quo and invent new ways of building a great product.
- Flexible hours. Join daily standups, sprint planning, and retrospective meetings. Other than that you’re in control of your own schedule.
- 100% remote. Work anywhere, whether it is remotely in the comfort of your home, in a shared co-working space, in an RV on the beach, or while being a nomad in another country.
- Work on challenging problems, innovate, and positively impact many people's lives while having fun doing it.
Required Qualifications
- Upper-intermediate to fluent speaking and writing English. Able to have a real-time conversation.
- 6+ years of full-time hands-on Data Engineer experience.
- 4+ years of full-time hands-on Python experience.
- 4+ years of full-time hands-on Airflow experience.
- 4+ years of full-time hands-on Databricks experience.
- 4+ years of full-time hands-on PySpark experience.
- 4+ years of full-time hands-on SQL experience.
- 2+ years of full-time hands-on AWS Glue experience.
- 2+ years of full-time hands-on Snowkflake experience.
- 1+ years of full-time hands-on NoSQL experience.
- Experience processing large datasets.
- CI/CD experience (Git, Jenkins).
- Experience with databases (Oracle, Redshift, Aurora).
- AWS Compute, Database, and Management tools experience.
- Skills Required - ETL, data flows, ingestion, reporting, analytics, general communication and technical troubleshooting.
- Primary Technology Stack - AWS, Glue, Snowflake, Airflow, Databricks, ETL, Lambda.
- Primary Responsibilities - The role is to help migrate a number of old ETL jobs (Lambda, Glue, Snowlfake) into the customer’s new ETL standard.
- (Airflow+Databricks) - The consultants would be part of the broader customer team executing this project, but still be expected to be able to operate independently.
Nice to haves
- Java/Spring Boot web app development experience.
- Microservices/RESTful API experience.
- AWS Certification/Cloud migration experience.
- Bachelor’s degree in Computer Science or equivalent demonstrated ability.
Frequently Asked Questions
What are your typical clients?
The majority of our clients are venture-backed startups at the growth stage. Usually, at this stage, the company already achieved a product-market fit and is looking to expand rapidly. That’s where we bring the best engineering practices, strong architecture, the latest technologies, and consistent processes to help companies scale.
What is the length of your engagements?
Most of our long-term full-time engagements last multiple years. It allows you to evolve your career with the client company taking on more responsibilities.
What’s your company size?
The Right Balance team is 60+ engineers going to 100+ by the end of the year. The current client size team is 150+ people. The timing is great to be a part of a rapidly growing team making meaningful contributions.
What happens if the engagement is completed?
Most of our engagements are long-term in nature. That said, if the current engagement is ramping down, we’ll present you with more long-term opportunities to transition into.
What are your core values?
Client First: we only win when our clients win. We treat client challenges as our own.
Ownership: we embrace responsibility, taking on challenges, getting them to completion, and enjoying getting things done.
Quality: we’re passionate about achieving quality outcomes by applying meticulous attention to detail.