**Senior Backend Engineer, Orchestration: Distributed Systems**
San Francisco Bay Area
A leading company in the data factory for generative AI provides the highest quality training data for frontier and task-specific models. This company's comprehensive platform combines on-demand labeling services with an industry-leading data labeling platform. The labeling service is powered by a community of highly-educated experts, who span all major languages and a diverse range of advanced subjects. They are available on-demand to rapidly generate new data for supervised fine-tuning, RLHF, and more. The software-first approach delivers unmatched control and transparency into the labeling process, leading to the generation of high-quality, consistent data at scale.
The company is backed by leading investors and serves Fortune 500 enterprises and leading AI labs.
**About the Role**
As a Senior Backend Software Engineer on the Orchestration engineering team, you will work on the critical distributed software architecture that drives the company's offerings for data labeling. You will develop features for orchestration of large-scale workflows using distributed queues, databases, message brokers, and job management mechanisms. You will own specific components of this area and work end-to-end on projects from design to delivery. You will use your experience and expertise to collaborate cross-functionally with Product, Design, and other stakeholders to transform ideas into shipped features and capabilities to drive scale and adoption of the offerings, as well as enable customers to be successful.
**Your Day to Day**
- Develop features and capabilities for orchestration of large-scale workflows using distributed queues, databases, message brokers, and job management mechanisms.
- Collaborate with team members and stakeholders.
- Participate in sprint planning, standups, and other related activities.
- Mentor and guide less experienced engineers while driving initiatives toward completion.
- Support the team’s area of ownership by working with the Support organization to help resolve any customer issues.
- Stay abreast of industry trends and emerging technologies, analyzing, assessing, and incorporating relevant technologies and ideas as needed.
- Contribute to technical documentation, research publications, blog posts, and presentations at conferences and forums.
**About You**
- Bachelor’s degree in computer science or related field. Advanced degree preferred.
- 5+ years of work experience in backend software engineering, specifically in distributed systems.
- Extensive software design and architecture skills in large-scale systems, including previous projects in this area.
- Strong grasp of databases, queues, job management, message brokers, in-memory caching, etc.
- Previous experience working with APIs using REST and GraphQL.
- Knowledge of using NodeJS for backend development. Experience with NestJS is preferred.
- Good understanding of memory management and related optimizations in large-scale systems.
- Interest in the overall Data + AI ecosystem and how it pertains to the design and architecture of large-scale AI platforms.
- Experience with container orchestration systems such as Kubernetes.
- Proficient in data structures and algorithms.
- Fluent in programming languages such as Typescript, Java, or Python.
- Demonstrated ability to keep up with industry trends and new developments.
- Excellent communication and collaboration skills.
- Strong sense of ownership.
- Thrive in a fast-paced environment with a willingness and ability to dive deep.
- Comfortable with ambiguity and able to break down high-level requirements into actionable tasks in a methodical manner.
- Resourceful and creative problem-solver with an attention to detail who will not hesitate to take initiative and get things done.
**Engineering at Our Company**
We build a comprehensive platform and end-to-end tool suite for AI system development. We believe in providing the best user experience at scale with high quality. Our customers use our platform in production environments daily to build and deploy AI systems that have a real positive impact in the world.
We believe in collaborative excellence and shared responsibility with decision-making autonomy wherever possible. We strive for a great developer experience with continuous fine-tuning. How we work is one of the cornerstones of engineering excellence at our company.
We learn by pushing boundaries, engaging in open debate to come up with creative solutions, and then committing to execution. We continuously explore and exploit new technologies, creating new and perfecting existing techniques and solutions. Making customers win is our North Star.
