Staff Software Engineer, Data Ingestion

As an engineer on the the Data Ingestion team you will be responsible for building and supporting the infrastructure to ingest and analyze multiple PBs/day of data coming from our self-driving cars, simulations, real-time services and other sources. This data powers Cruise, from top-line metrics to the neural networks that run on the cars. Responsibilities include ensuring scalable, transparent, and reliable data ingestion and management platform. You’ll develop tools, data pipelines & APIs to accelerate log consumption and exploitation & building scalable services.

What you will be doing:

• Lead us in the development, optimization and productionization of the next generation data ingestion.
• Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud. Champion engineering excellence by continuously improving systems and processes
• Build self-serve capabilities to help customers to adopt the next generation data ingestion platform
• Leverage production best practices to guarantee a reliable platform for log ingestion across stakeholders in the organization.
• Optimize data pipelines handling data from millions of miles of on-road

What you must have:

• Experience building data ingestion systems and services
• Experience working with big data tools such as Apache Hadoop, Spark, Beam, Kafka or other data processing tools
• Experience building scalable infrastructure on the cloud with Python or Java (or similar)
• Experience building backend software systems networking, load balancing, API gateways, system security, gRPC services.
• Experience with database design, database management and database.
• Comfortable working with the PB scale of dataset and championing engineering excellence by continuously optimizing the systems and processes with SLO/SLA in mind.

Bonus Points

• Experience with large scale distributed systems or microservice architectures
• A passion for writing robust, intuitive, high-performance code, and being pragmatic about it
• Ability to navigate and work efficiently in large codebase
• Understanding the decoding and encoding of sensor data
• Strong software development background demonstrated by industry experience in building platforms that serve AV development and commercialization.

The salary range for this position is $193,900 – 285,000. Compensation will vary depending on location, job-related knowledge, skills, and experience. You may also be offered a bonus, restricted stock units, and benefits. These ranges are subject to change.