echoloc
Company profile

Together AI Tech Stack

GPU cloud for AI inference, fine-tuning and model training

Software Development San Francisco, California 201–500 employees Founded 2022 Privately Held

Together AI runs a GPU cloud for AI engineers, with a stack built on CUDA, Triton, FlashAttention, vLLM, SGLang and TensorRT-LLM across AWS, GCP and Azure. Adoption of WEKA, Lustre, Ceph and NVMe-oF points to a storage overhaul for large clusters, while Cartesia and Deepgram signal a push into real-time voice inference. Hiring is accelerating and skews heavily toward senior engineering, focused on GPU fleet reliability and kernel-level performance.

Tech Stack 182 technologies

Core StackOkta Stripe Ansible Kubernetes AWS Python PyTorch C++ Slack RAG Salesforce Slurm cURL GCP Azure CUDA Triton FlashAttention vLLM TensorRT-LLM SGLang LoRA RLHF TensorRT PagedAttention HDFS Ceph RDMA TPU Pipedrive+146 more
AdoptingKubernetes WEKA Ceph Lustre AWS EKS Cartesia Deepgram NVMe-oF+7 more

What Together AI Is BuildingChallenges and projects from their job posts

◆Challenges

  • Lowering the cost of modern AI systems
  • Diagnosing hardware failures in GPU clusters
  • Optimizing latency at massive concurrent user scale
  • Scaling real-time voice inference
  • Ensuring reliability and investigating incidents
  • Improving release velocity

▲Active Projects

  • Inference engine and GPU kernel optimization
  • Production AI agent systems for GPU fleet
  • Kubernetes-native storage operators
  • Post-training and fine-tuning capabilities
  • Integrating partner models into serving stack
  • Scalable infrastructure with Ansible, Terraform, Kubernetes

Hiring Activity

Accelerating80 roles · 30 in 30d

Department

Engineering
43
Sales
7
Research
6
Ops
5
Support
4
Finance
3
HR
3
Marketing
3

Seniority

Senior
38
Mid
14
Intern
11
Staff
7
Director
3
Junior
2
Lead
2
Manager
2
Companies like Together AI

100+ Software Development companies running Okta and Stripe

See the full list

About Together AI

Together AI is a San Francisco-based, privately held company founded in 2022 with 201–500 employees. It offers a full-stack AI platform covering inference, fine-tuning and post-training, and pre-training on GPU infrastructure. Customers range from AI-native startups to established SaaS companies building AI applications. The platform spans a high-performance inference engine, on-demand GPU clusters and large-scale training capacity. The company is hiring across the United States, United Kingdom, Netherlands, Singapore and India.

HeadquartersSan Francisco, California
Company Size201–500 employees
Founded2022
Hiring MarketsSingapore, United States, United Kingdom, Netherlands, India

Frequently Asked Questions

What tech stack does Together AI use?

Together AI uses PyTorch, CUDA, Triton, vLLM, SGLang, TensorRT-LLM and FlashAttention, running on Kubernetes and Slurm across AWS, GCP and Azure, with Ceph, HDFS and RDMA for storage and networking.

Is Together AI hiring engineers?

Yes. Engineering dominates Together AI's accelerating hiring, weighted toward senior and staff roles, alongside research, sales and operations positions.

What countries does Together AI hire in?

Together AI hires in the United States, United Kingdom, Netherlands, Singapore and India, with headquarters in San Francisco, California.

Similar Companies in Software Development

Other companies in the same industry, closest in size

How this profile is built

Together AI's technology stack, projects, and hiring signals are inferred from public hiring and company data — career pages, public listings, and company web presence — then clustered and de-duplicated. Figures are estimates that refresh over time. Read our full methodology →

This is not an official vendor or customer list. It is a technology-adoption signal inferred from public data, intended for B2B research.