As an engineer on the the Data Ingestion team you will be responsible for building and supporting the infrastructure to ingest and analyze multiple PBs/day of data coming from our self-driving cars, simulations, real-time services and other sources. This data powers Cruise, from top-line metrics to the neural networks that run on the cars. Responsibilities include ensuring scalable, transparent, and reliable data ingestion and management platform. You’ll develop tools, data pipelines & APIs to accelerate log consumption and exploitation & building scalable services.

What you will be doing:

  • Lead us in the development, optimization and productionization of the next generation data ingestion.
  • Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud. Champion engineering excellence by continuously improving systems and processes
  • Build self-serve capabilities to help customers to adopt the next generation data ingestion platform
  • Leverage production best practices to guarantee a reliable platform for log ingestion across stakeholders in the organization.
  • Optimize data pipelines handling data from millions of miles of on-road

What you must have:

  • Experience building data ingestion systems and services
  • Experience working with big data tools such as Apache Hadoop, Spark, Beam, Kafka or other data processing tools
  • Experience building scalable infrastructure on the cloud with Python or Java (or similar)
  • Experience building backend software systems networking, load balancing, API gateways, system security, gRPC services.
  • Experience with database design, database management and database.
  • Comfortable working with the PB scale of dataset and championing engineering excellence by continuously optimizing the systems and processes with SLO/SLA in mind.

Bonus Points

  • Experience with large scale distributed systems or microservice architectures
  • A passion for writing robust, intuitive, high-performance code, and being pragmatic about it
  • Ability to navigate and work efficiently in large codebase
  • Understanding the decoding and encoding of sensor data
  • Strong software development background demonstrated by industry experience in building platforms that serve AV development and commercialization.

The salary range for this position is $193,900 – 285,000. Compensation will vary depending on location, job-related knowledge, skills, and experience. You may also be offered a bonus, restricted stock units, and benefits. These ranges are subject to change.

Job Overview
Job alerts

Subscribe to our weekly job alerts below and never miss the latest jobs

Sign in

Sign Up

Forgotten Password

Job Quick Search