Software Engineer, Platform

Software Engineer, Platform LocationSan Francisco, CAEmployment TypeFull timeLocation TypeOn-siteDepartmentEngineeringCompensationSalary $200K – $250K • Offers EquityWe're building Skyway, a platform to help companies find, procure, manage, and forecast hyperscaler, inference, and GPU infrastructure. With the explosive growth of AI, companies are signing the largest infrastructure agreements in history and doing it all with spreadsheets and fingers-in-the-wind. Skyway provides structure and data to make the problem suck a whole lot less.Our customers are the strategic finance and engineering leaders at AI labs, inference providers, neoclouds, and AI-native software companies who are making seven, eight, nine, ten-figure compute decisions using data that flows through our systems.Under the hood, we're turning unstructured agreements—hyperscaler private pricing agreements, AI lab MSAs and prepaid credits, neocloud reserved capacity—into structured data, dynamically recalculating bills against both contract and public pricing, and giving finance and engineering a single shared set of numbers for what they've consumed, are consuming, and will consume.Our goal is to be the system every AI-native company runs its compute strategy on: forecasting, scenario modeling, commitment tracking, invoice validation, benchmarking, and purchasing, all on top of the best proprietary pricing dataset in the world.What you'll doOwn the data infrastructure that powers everything. Build and maintain both streaming and batch data processing that process hundreds of millions of rows of billing data per customer, whether the data is streamed via OTel, near-realtime API pulls, or batched S3 ingestion.Build the contract application engine. Skyway doesn't just ingest consumption data—we also enrich and transform it substantially. You'll work on the logic that matches usage lines to contract terms, applies negotiated contract rates, and produces the financial outputs customers rely on. Getting this right is what separates us from being “a data pipeline with a graph on it” and a proper financial product.Become an expert on AI and cloud billing data. You'll master provider billing schemas, quirks, and evolution. You'll be diagnosing data anomalies regularly and documenting the tribal knowledge that makes this data so difficult to work with.Design the data model for multi-provider support. Each provider structures their billing data differently—different columns, different granularity, different pricing concepts. We ingest from a variety of source formats, such as OTel, HTTP APIs, and Parquet. You'll help make foundational decisions about how and when we normalize across providers, how we handle cross-provider queries, and how we keep provider-native detail accessible for deep dives.Build bulletproof data validation. Design quality control systems that catch issues before they reach customers. Financial data demands precision and a data quality bug can represent a customer breach in trust, not just an annoyance.Optimize for performance at scale. Design storage patterns, partitioning strategies, and query approaches that serve sub-second performance alongside heavy analytical workloads.Work across the stack. You'll collaborate with backend engineers on data contracts and APIs, help the product team understand what's possible with the data, and be the person who can answer "why does this number look like that?" when something seems off. This isn't a throw-it-over-the-wall role—our platform engineers are core to everything we do.Our stack today is Python, ClickHouse, Airflow, Parquet on S3, with a Flask backend and React frontend. You’ll help us decide how this evolves, though we are quite keen on durable execution systems and embedded databases . What matters more than any specific tool is that you have strong opinions about data systems and the experience to back them up.How we workYou’ll be given more autonomy than you’re comfortable with. Our engineering team...