echoloc
Company profile

GMI Cloud Tech Stack

GPU cloud for AI training, inference, and model serving

IT System Data Services Mountain View, California 51–200 employees Founded 2023 Privately Held

GMI Cloud runs a GPU cloud built on NVIDIA H100/H200, InfiniBand/RDMA and NCCL, with vLLM, SGLang and TensorRT-LLM in the inference layer and Slurm plus Kubernetes for orchestration. Senior-heavy, accelerating hiring across engineering, ops and logistics points to physical data center buildout, not just software. OpenTelemetry adoption alongside Prometheus, Grafana and Mimir lines up with stated pain around GPU observability.

Tech Stack 102 technologies

Core StackKubernetes AWS OpenAI Anthropic Asana Prometheus Grafana Elasticsearch Ansible Jenkins GitLab CI/CD NVIDIA Azure GCP xAI vLLM SGLang TensorRT-LLM Slurm OpenSearch NVIDIA H100 NVIDIA H200 NVIDIA AI Enterprise InfiniBand RDMA NCCL MPI BMS OpenStack Mimir+68 more

What GMI Cloud Is BuildingChallenges and projects from their job posts

◆Challenges

  • Scaling GPU compute infrastructure
  • Scaling security for GPU-as-a-service
  • Supply chain disruptions and bottlenecks
  • Improving system reliability
  • Optimizing energy efficiency
  • Coordinating multi-vendor infrastructure projects

▲Active Projects

  • Global data center and AI/ML network buildout
  • GPUaaS platform for large-scale training and inference
  • Automated GPU/CPU provisioning and infrastructure CI/CD
  • Observability and telemetry for GPU clusters
  • Vulnerability management program

Hiring Activity

Accelerating55 roles · 35 in 30d

Department

Engineering
21
Ops
9
Logistics
5
Finance
4
Marketing
4
Security
4
Sales
2
HR
1

Seniority

Senior
29
Mid
11
Director
6
Lead
4
Manager
2
Junior
1

Notable leadership hires: Security Director

Companies like GMI Cloud

60+ IT System Data Services companies running AWS

See the full list

About GMI Cloud

GMI Cloud is a privately held AI infrastructure provider founded in 2023 and headquartered in Mountain View, California. It offers GPU compute as a service along with a software platform for deploying and scaling ML and LLM workloads, including model-as-a-service offerings. The company serves businesses globally and employs 51–200 people. Hiring spans Taiwan, China, Japan, Singapore, Uganda and the United States.

HeadquartersMountain View, California
Company Size51–200 employees
Founded2023
Hiring MarketsTaiwan, China, Uganda, United States, Japan, Singapore

Frequently Asked Questions

What GPUs does GMI Cloud use?

GMI Cloud's stack includes NVIDIA H100 and H200 GPUs, NVIDIA AI Enterprise, and InfiniBand/RDMA networking with NCCL and MPI for multi-GPU communication.

What tech stack does GMI Cloud use for inference?

GMI Cloud uses vLLM, SGLang and TensorRT-LLM for model serving, orchestrated with Kubernetes and Slurm, and monitored with Prometheus, Grafana and Mimir, now adopting OpenTelemetry.

What countries does GMI Cloud hire in?

GMI Cloud hires in Taiwan, China, Japan, Singapore, Uganda and the United States, with engineering, ops and logistics leading the mix and a Security Director role open.

Similar Companies in IT System Data Services

Other companies in the same industry, closest in size

How this profile is built

GMI Cloud's technology stack, projects, and hiring signals are inferred from public hiring and company data — career pages, public listings, and company web presence — then clustered and de-duplicated. Figures are estimates that refresh over time. Read our full methodology →

This is not an official vendor or customer list. It is a technology-adoption signal inferred from public data, intended for B2B research.