Software Engineer - Kafka
Applied Compute
Location
Sunnyvale
Employment Type
Full time
Department
Data Engineering
About the role
As the data engine team, our goal is to provide a central data and machine learning platform that can be used across all verticals of the company. We’re looking for generalist engineers that want to build the foundations of a new workflow that spans:
Data ingestion from a production fleet
Data processing and storage (TBs/car/day)
Labeling infrastructure
Machine learning infrastructure
This group has a massive scope to define how product verticals across the company are deployed at scale for our customers given data and machine learning infrastructure is at the heart of the autonomy problem. We’re still very early in development so if you are interested in the “0-1” stage of building up a new team that interacts with teams across the company, this is a good fit.
At Applied Intuition, you will:
Design and build large-scale data platforms to support our AI research and autonomy stack development, handling petabytes of multimodal sensor data from real-world driving scenarios
Work on data curation and tagging platforms that enable efficient dataset discovery, labeling workflows, and quality assessment across diverse driving conditions
Build high-performance data processing systems using modern distributed computing frameworks to transform raw sensor data into training-ready formats
Use the following technologies: Apache Spark, Apache Hudi, Trino, Apache Kafka, Flyte, Kubernetes, Python, Golang, Java
We're looking for someone who has:
Strong backend engineering experience
Problem-solving skills and experience working with cross-functional teams in fast-paced environments
Nice to have:
Hands-on experience with modern data stack technologies including Apache Spark, Hudi, Trino, Kafka, or similar distributed data processing frameworks
Knowledge of data lake architectures, streaming systems, and workflow orchestration platforms like Flyte
Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment.
Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position.
Please reference the job posting’s subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the location listed is: $153,000 - $222,000 USD annually.