{ "id": "pct-2026-11-09-company-together-ai", "content_type": "article", "desk": "company", "title": "Together AI sells predictability, then has to build it", "publication_date": "2026-11-09", "observation_date": "2026-11-09", "editorial_voice": "Company Desk | AI-assisted, measured business columnist", "body": "A reader asking a newspaper a question is not buying a GPU. The reader wants a useful answer while the question still matters. The newspaper, meanwhile, needs a service it can afford to keep running. Together AI occupies the space between those two expectations: it sells the work of turning available models and computing capacity into a dependable product.\n\nIts Washington Post case study gives that proposition a concrete shape. Together reports 1.79 billion monthly input tokens, thousands of daily queries and roughly two-second model responses for Ask The Post AI. The deployment combines dedicated and serverless inference, uses Llama and Mistral models, and has fixed monthly pricing. The amount of that bill is not disclosed. These are vendor-published customer results, not an independently reproduced benchmark. [Customer case study](https://www.together.ai/customers/washington-post).\n\nThe Post's own announcement dates the launch to November 7, 2024. [The Post’s launch announcement](https://www.washingtonpost.com/pr/2024/11/07/washington-post-launches-ask-post-ai-new-search-experience/).\n\nThe attraction is understandable: keep more control over the model without taking on the entire job of serving it. But removing one dependency creates another. Together has to earn its place through engineering, capacity and service, while charging enough to cover them. Its new compiler and its much larger infrastructure commitments show both sides of that bargain.\n\n## A financing round is not an income statement\n\nOn July 1, Together announced an $800 million Series C. The release carried by lead investor Aramco Ventures specified an $8.3 billion post-money valuation, thousands of paying customers and annual bookings that had crossed $1.15 billion in the previous quarter. It also described an ambition to increase the infrastructure footprint roughly fiftyfold over five years. Those are company and investor disclosures, with financial interests attached. [Financing release](https://aramcoventures.com/news/together-ai-raises-800-million-at-8-3-billion-valuation-to-make-frontier-ai-accessible-to-all/).\n\nBookings deserve their own label. They are not interchangeable with recognized revenue, annual recurring revenue or cash collected. The release does not provide enough detail about contract duration, cancellation rights or the calculation to turn its headline into any of those measures. Nor does a valuation tell readers whether selling inference is already profitable. The business can be expanding rapidly while those questions remain open.\n\nCEO Vipul Ved Prakash's accompanying essay added another distinction: the company said it had secured commitments for more than 500 megawatts of compute capacity, to be capitalized independently by new investors. That is a statement about future supply and financing arrangements, not a claim that 500 megawatts were already serving customers. [July 1 company essay](https://www.together.ai/blog/announcing-our-series-c).\n\nSeparate financing may reduce the equity Together itself must devote to physical infrastructure. It does not, by itself, disclose who bears an idle machine's cost. A buyer can rent instead of own and still have a substantial obligation to pay. The missing information is the connection between customer commitments, supplier commitments and the dates on which each becomes binding. That connection matters more to the economics than the label attached to the cloud.\n\n## The capacity arrives on a different clock\n\nIBM supplied a more specific example on August 11. The companies announced a multi-year $240 million agreement for an NVIDIA HGX B300 cluster on IBM Cloud, with availability expected in the first quarter of 2027. Together would use it for open-model inference. IBM also identified Spectrum-X networking. As of this article's November 9 observation date, this is announced future capacity, not an operational cluster verified by this reporting. [IBM announcement](https://newsroom.ibm.com/2026-08-11-IBM-and-Together-AI-Sign-Multi-Year-Agreement-to-Scale-Open-Source-AI-Inference-with-NVIDIA-AI-Infrastructure-on-IBM-Cloud).\n\nThe announcement does not specify the agreement's exact length, payment schedule, minimum draw or termination provisions. Dividing $240 million by an assumed number of years would manufacture an annual cost. Treating the amount as immediate expenditure, or as revenue already earned by either party, would be equally premature. A large agreement is evidence of commercial intent; its cash consequences depend on terms the release does not show.\n\nThe strategic logic is nevertheless clear. Customer-facing inference needs supply that can be counted on, and reserved supply needs customers who will use it. If those commitments line up, a specialist can combine purchasing scale with software efficiency. If customer demand changes faster than the capacity arrangement, the same structure can leave expensive resources attached to yesterday's forecast. This is a conditional business risk, not evidence that Together has excess capacity today.\n\nThere is also a timing problem distinct from demand. A customer can begin paying for an application before a planned cluster is delivered, or need more capacity while an expansion is still under construction. A credible growth story therefore needs an operating bridge between the existing fleet and the future one. An infrastructure announcement explains where additional supply is intended to come from. It does not show that bridge's cost or spare capacity.\n\n## Software has to pay its way\n\nTogether's answer is not simply to acquire more GPUs. On November 4, it announced Together Compiler as part of a broader effort to adapt inference software to changing models, hardware and traffic. The company says AI agents search for faster implementations and that the compiler already supports some production serverless endpoints. Customer access was described as a limited beta; self-service optimization of dedicated deployments remained forthcoming. [November 4 announcement](https://www.together.ai/blog/polymorphic-inference).\n\nThe underlying engineering idea has a more restrained precedent. A May 27, 2025 Hazy Research post examined a single-sequence Llama-3.2-1B workload on an H100. Combining operations into one larger GPU program reduced gaps between operations; the researchers reported using 78% of memory bandwidth and beating the tested systems by more than 1.5 times. That was a narrow, disclosed experiment, not a universal inference speedup. [Research and test scope](https://hazyresearch.stanford.edu/blog/2025-05-27-no-bubbles).\n\nThe commercial interpretation is simple: more completed work from the same hardware can create room for a lower customer price, a better provider margin, or both. But the benefit must survive the actual workload. A fast result on a small model with one user does not establish the cost of serving many users, longer prompts or a different model. Efficiency is valuable precisely because it has to be achieved in specific circumstances.\n\nTogether's current product page says candidate optimizations are checked for speed and correctness before production use. It reports up to 2.6 times the tokens per GPU at matched per-user speed in a set of Blackwell tests, following a 24-hour compilation using two nodes per model. The page also says supported serverless customers receive compiled kernels without a price change. These are the vendor's measurements and product claims. [Compiler product details](https://www.together.ai/polymorphic-inference).\n\nThat last detail makes the business question sharper. If the customer pays the same token price and Together needs less hardware time, the provider could retain some savings. Competition could instead push the selling price down. Maintaining an advantage then requires repeated improvements, not a single published result. The research team is potentially part of the production cost structure as well as the sales story, and automation is an attempt to make that expertise serve more workloads.\n\n## Predictability has a utilization bill\n\nTogether's public menu makes the software premium visible without revealing its margin. On November 9, an H100 was listed at $5.49 per GPU-hour for dedicated inference and $3.99 for on-demand GPU clusters. These are different products, not interchangeable quotes. The $1.50 difference cannot be called profit: serving software, support, configuration and underlying supply economics all matter. [Observed pricing](https://www.together.ai/pricing).\n\nFor reserved token capacity, the documentation describes provisioned throughput units, or PTUs, at $0.05 per unit per minute. Input, output and cached tokens draw on capacity at different, model-specific rates. Unused units do not roll over or receive a refund. Commitments are tied to a model or model family; changing models requires discussion with sales. [Provisioned throughput documentation](https://docs.together.ai/docs/inference/provisioned-throughput).\n\nAt that published rate, one continuously reserved PTU over exactly thirty days costs $2,160 before any additional charges; ten cost $21,600. This is arithmetic, not a customer quote or a statement that one unit can run a particular application. If the same reservation serves half as much useful work, its cost per completed unit of work doubles. A predictable bill removes surprise from spending, not from demand.\n\nThe service promise also needs careful reading. Marketing uses a 99% uptime shorthand, but the documentation defines reliability as at least 99% of eligible requests completing successfully each month without a Together-caused error. Requests outside purchased capacity and stated limits are excluded. Overflow may use shared serverless capacity at standard rates, without the PTU guarantee. A request-success measure is not a promise about clock-time availability. [Product overview](https://www.together.ai/provisioned-throughput); [Detailed terms](https://docs.together.ai/docs/inference/provisioned-throughput).\n\nThis is the practical bargain beneath the fixed bill: the customer buys a defined amount of preparedness, not an unlimited safety net. Steady traffic can make the commitment attractive. Sharp peaks can require more reserved capacity or expose overflow to a different service level. Together benefits when reservations and available machines can be planned together. The buyer benefits when the purchased shape resembles the workload. Neither side wins automatically merely because billing is predictable.\n\n## Model choice is not a finished exit plan\n\nThe Washington Post deployment is useful because it shows an actual application rather than a hypothetical model migration. It does not establish the Post's complete unit economics. The public case study gives neither the total monthly charge nor the output-token volume and workload distribution needed to reproduce the bill. Its response-time result also does not disclose a percentile or a complete end-to-end measurement method.\n\nFor any customer, retaining model access and retaining a cheap, fast deployment are different things. Moving a model to another provider may be possible while still requiring integration work, performance tuning and new capacity commitments. The value of a specialist is partly the work it saves. That same saved work can become work the customer must recreate when leaving. This is an operational switching cost, even without an exclusive model contract.\n\nTogether therefore has a plausible position between self-operated infrastructure and a closed model API. It can sell a managed service while leaving more model choice with the customer. The durable advantage would be making that freedom economical in practice: serving the chosen model efficiently, adapting when it changes, and keeping capacity available without pricing away the benefit.\n\n## What would make the case stronger\n\nThe next revealing disclosures would connect bookings to recognized revenue and cash, distinguish committed capacity from live supply, and show the cost of keeping customer promises. Research results should be followed by production economics on comparable workloads. The November compiler announcement makes the software argument more concrete; the IBM agreement makes the supply ambition more concrete. Neither, alone, proves the margin between them.\n\nFor the newspaper's reader, all of this remains backstage. A useful answer arrives, or it does not. Together's opportunity is to make that ordinary experience easier for customers to deliver at scale. Its test is to turn the engineering and capacity required for predictability into a business that is predictable enough itself.", "sources": [ { "id": "S1", "stable_id": "pct-2026-11-09-company-together-ai-source-s1", "title": "How The Washington Post Achieved AI Independence with Reliable Inference", "publisher": "Together AI", "url": "https://www.together.ai/customers/washington-post", "published_at": null, "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Vendor customer case study; named customer, unverified measurement method and undisclosed contract price.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": null, "observation_date": "2026-11-09" }, { "id": "S2", "stable_id": "pct-2026-11-09-company-together-ai-source-s2", "title": "The Washington Post Launches “Ask The Post AI,” a New Search Experience", "publisher": "The Washington Post", "url": "https://www.washingtonpost.com/pr/2024/11/07/washington-post-launches-ask-post-ai-new-search-experience/", "published_at": "2024-11-07", "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Customer-origin launch announcement; used only to confirm the launch date.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": "2024-11-07", "observation_date": "2026-11-09" }, { "id": "S3", "stable_id": "pct-2026-11-09-company-together-ai-source-s3", "title": "Together AI Raises $800 Million at $8.3 Billion Valuation to Make Frontier AI Accessible to All", "publisher": "Aramco Ventures / Together AI", "url": "https://aramcoventures.com/news/together-ai-raises-800-million-at-8-3-billion-valuation-to-make-frontier-ai-accessible-to-all/", "published_at": "2026-07-01", "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Company financing release reproduced by lead investor. Post-money basis explicit; bookings are not revenue.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": "2026-07-01", "observation_date": "2026-11-09" }, { "id": "S4", "stable_id": "pct-2026-11-09-company-together-ai-source-s4", "title": "Announcing our $800M Series C to accelerate the shift to open-source AI", "publisher": "Together AI / Vipul Ved Prakash", "url": "https://www.together.ai/blog/announcing-our-series-c", "published_at": "2026-07-01", "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "CEO essay; independently capitalized future capacity is a company-reported commitment.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": "2026-07-01", "observation_date": "2026-11-09" }, { "id": "S5", "stable_id": "pct-2026-11-09-company-together-ai-source-s5", "title": "IBM and Together AI Sign Multi-Year Agreement to Scale Open-Source AI Inference with NVIDIA AI Infrastructure on IBM Cloud", "publisher": "IBM", "url": "https://newsroom.ibm.com/2026-08-11-IBM-and-Together-AI-Sign-Multi-Year-Agreement-to-Scale-Open-Source-AI-Inference-with-NVIDIA-AI-Infrastructure-on-IBM-Cloud", "published_at": "2026-08-11", "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Contracting counterparty announcement. Q1 2027 is expected availability, not current operation.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": "2026-08-11", "observation_date": "2026-11-09" }, { "id": "S6", "stable_id": "pct-2026-11-09-company-together-ai-source-s6", "title": "From Static to Polymorphic Inference: A new era for production open-source inference systems", "publisher": "Together AI / Simran Arora and Dan Fu", "url": "https://www.together.ai/blog/polymorphic-inference", "published_at": "2026-11-04", "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Product and research announcement; beta and forthcoming self-serve functions distinguished from deployed endpoints.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": "2026-11-04", "observation_date": "2026-11-09" }, { "id": "S7", "stable_id": "pct-2026-11-09-company-together-ai-source-s7", "title": "Polymorphic Inference", "publisher": "Together AI", "url": "https://www.together.ai/polymorphic-inference", "published_at": null, "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Live product page; performance is vendor-tested and workload-specific, not independently reproduced.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": null, "observation_date": "2026-11-09" }, { "id": "S8", "stable_id": "pct-2026-11-09-company-together-ai-source-s8", "title": "Look Ma, No Bubbles! Designing a Low-Latency Megakernel for Llama-1B", "publisher": "Stanford Hazy Research and named authors", "url": "https://hazyresearch.stanford.edu/blog/2025-05-27-no-bubbles", "published_at": "2025-05-27", "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Original research description; H100, Llama-3.2-1B, one sequence, 32-token prompt and 128 generated tokens in cited figure.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": "2025-05-27", "observation_date": "2026-11-09" }, { "id": "S9", "stable_id": "pct-2026-11-09-company-together-ai-source-s9", "title": "Pricing", "publisher": "Together AI", "url": "https://www.together.ai/pricing", "published_at": null, "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Live advertised prices observed November 9; product distinctions preserved, no availability or delivered quote implied.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": null, "observation_date": "2026-11-09" }, { "id": "S10", "stable_id": "pct-2026-11-09-company-together-ai-source-s10", "title": "Provisioned throughput", "publisher": "Together AI documentation", "url": "https://docs.together.ai/docs/inference/provisioned-throughput", "published_at": null, "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Live docs; exact requested-success SLA and exclusions preferred to marketing shorthand. Contract-specific terms were not reviewed.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": null, "observation_date": "2026-11-09" }, { "id": "S11", "stable_id": "pct-2026-11-09-company-together-ai-source-s11", "title": "Provisioned Throughput", "publisher": "Together AI", "url": "https://www.together.ai/provisioned-throughput", "published_at": null, "updated_at": null, "retrieved_at": "2026-11-09", "evidence_type": "primary", "verification": "Live marketing page; 99% uptime wording differs from request-success metric in docs. Not represented as a negotiated contract.", "license_status": "Rights retained by source publisher; public availability is not a republication license. Facts paraphrased, no source imagery reproduced.", "publication_date": null, "observation_date": "2026-11-09" } ], "facts": [ { "id": "F1", "source_ids": [ "S1" ], "claim": "Together reports a Washington Post hybrid dedicated/serverless deployment, 1.79B monthly input tokens, thousands of queries daily, approximately two-second model responses, Llama/Mistral and fixed monthly pricing.", "fields": { "monthly_input_tokens": 1790000000, "model_response_seconds_approx": 2, "price_disclosed": false }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F2", "source_ids": [ "S2" ], "claim": "The Post announced Ask The Post AI on November 7, 2024.", "fields": { "launch_date": "2024-11-07" }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F3", "source_ids": [ "S3" ], "claim": "July 1 company/investor release disclosed the financing and company-reported bookings.", "fields": { "series_c_usd": 800000000, "post_money_valuation_usd": 8300000000, "annual_bookings_reported_lower_bound_usd": 1150000000, "bookings_definition": "Not supplied in reviewed release", "infrastructure_footprint_growth_goal_5_years": 50 }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F4", "source_ids": [ "S4" ], "claim": "Company said more than 500MW compute-capacity commitments would be capitalized independently by new investors.", "fields": { "capacity_commitment_mw_lower_bound": 500, "status": "reported commitment; not verified operational capacity" }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F5", "source_ids": [ "S5" ], "claim": "IBM announced a multi-year $240m agreement with Together for an HGX B300 inference cluster.", "fields": { "agreement_value_usd": 240000000, "announcement_date": "2026-08-11", "expected_availability": "2027-Q1", "exact_contract_years": null }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F6", "source_ids": [ "S6" ], "claim": "November 4 compiler announcement describes production use on some serverless endpoints, limited beta customer access and forthcoming self-service dedicated optimization.", "fields": {}, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F7", "source_ids": [ "S8" ], "claim": "Original megakernel experiment reports 78% H100 memory-bandwidth use and over 1.5x performance versus tested systems for a specified one-sequence Llama-3.2-1B workload.", "fields": { "gpu": "H100", "model": "Llama-3.2-1B", "memory_bandwidth_utilization": 0.78, "prompt_tokens": 32, "generated_tokens": 128 }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F8", "source_ids": [ "S7" ], "claim": "Company compiler page reports up to 2.6x tokens per GPU at matched per-user speed in specified Blackwell tests and unchanged prices for supported serverless models.", "fields": { "maximum_claimed_throughput_multiple": 2.6, "compile_hours": 24, "compile_nodes_per_model": 2, "independently_reproduced": false }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F9", "source_ids": [ "S9" ], "claim": "Observed H100 dedicated inference and on-demand cluster list prices differ.", "fields": { "dedicated_inference_usd_per_gpu_hour": 5.49, "cluster_on_demand_usd_per_gpu_hour": 3.99, "observed_on": "2026-11-09", "equivalent_products": false }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F10", "source_ids": [ "S10" ], "claim": "PTUs cost $0.05 per minute; token conversion is model-specific; unused capacity is not refunded or rolled over; changing model requires sales contact.", "fields": { "usd_per_ptu_minute": 0.05, "unused_rollover": false, "unused_refund": false }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." }, { "id": "F11", "source_ids": [ "S10", "S11" ], "claim": "Docs guarantee at least 99% eligible-request success monthly for Together-caused failures, not 99% clock uptime; overflow is excluded and best-effort.", "fields": { "eligible_request_success_monthly": 0.99, "overflow_covered_by_ptu_sla": false }, "qualifier": "See source verification; company statements and benchmark claims retain attribution." } ], "inferences": [ { "id": "I1", "claim": "Customer value is a dependable application, while control over models does not remove serving dependencies.", "based_on_fact_ids": [ "F1" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I2", "claim": "Software efficiency and capacity procurement jointly determine the business proposition.", "based_on_fact_ids": [ "F5", "F6" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I3", "claim": "Bookings and valuation do not establish recognized revenue, ARR, cash collections or profitability.", "based_on_fact_ids": [ "F3" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I4", "claim": "Separate capitalization does not establish absence of payment or idle-capacity risk.", "based_on_fact_ids": [ "F4" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I5", "claim": "Agreement value cannot be annualized without exact term or interpreted as immediate expenditure/revenue.", "based_on_fact_ids": [ "F5" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I6", "claim": "Customer and supplier timing mismatches are conditional operating risks, not evidence of existing excess capacity.", "based_on_fact_ids": [ "F4", "F5" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I7", "claim": "Narrow research results require workload-specific validation before commercial extrapolation.", "based_on_fact_ids": [ "F7" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I8", "claim": "Efficiency savings could benefit provider margin, customer price or both; repeated optimization is economically relevant.", "based_on_fact_ids": [ "F6", "F8" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I9", "claim": "The $1.50/H100-hour product price gap is not a gross-margin measure.", "based_on_fact_ids": [ "F9" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I10", "claim": "At $0.05/minute, one PTU for 30 continuous days is $2,160; ten are $21,600. Half the useful work on the same reservation doubles reserved cost per unit of work.", "based_on_fact_ids": [ "F10" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I11", "claim": "Eligible-request success is not clock-time availability.", "based_on_fact_ids": [ "F11" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I12", "claim": "Reservation economics depend on demand shape and utilization; overflow has a different risk profile.", "based_on_fact_ids": [ "F10", "F11" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I13", "claim": "Model portability and deployment portability differ; recreating saved engineering work can be a switching cost.", "based_on_fact_ids": [ "F1", "F6" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I14", "claim": "Managed serving and model choice form a plausible position, but customer savings require real operating performance.", "based_on_fact_ids": [ "F1", "F8" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I15", "claim": "Financial, operating-supply and production-efficiency disclosures would strengthen assessment beyond financing and benchmarks.", "based_on_fact_ids": [ "F3", "F5", "F8" ], "status": "editorial_inference_not_reported_fact" }, { "id": "I16", "claim": "The core business test is delivering dependable outputs at a sustainable provider cost.", "based_on_fact_ids": [ "F1", "F5", "F8" ], "status": "editorial_inference_not_reported_fact" } ], "unknowns": [ { "id": "U1", "text": "Washington Post price, output-token volume, workload distribution, latency percentile and complete end-to-end timing methodology are undisclosed in the reviewed case study." }, { "id": "U2", "text": "Together recognized revenue, profit, cash flow, booking methodology, cancellation rights, contract-duration mix and concentration were not established by the reviewed financing sources." }, { "id": "U3", "text": "IBM agreement exact duration, payment schedule, minimum draw and termination terms are not disclosed in the reviewed announcement. The cluster was not independently verified operational." }, { "id": "U4", "text": "Commercial terms, delivery schedule and risk allocation for the separately capitalized 500MW commitments remain unspecified in the reviewed CEO essay." }, { "id": "U5", "text": "Compiler results were not independently reproduced. Provider-wide savings, margins and performance on any customer workload are unknown." }, { "id": "U6", "text": "PTU minimum purchases, negotiated term, remedies, all-in charges and conversion for any specific workload require an actual quote and contract." } ], "correction_history": [], "license_status": "Original PCT editorial text; public license not selected. Source rights remain separate.", "public_url": null, "schema_version": "pct-research-item-1.0", "desk_extensions": { "schema_version": "pct.article.v1", "dek": "A newspaper’s inference workload, a new compiler and a $240 million capacity agreement reveal the economics behind the open-model cloud.", "status": "ready_for_editorial_review", "body_derivation": { "canonical_field": "sections", "method": "Join section headings and paragraph text in order. Body is a derived rendering, not an independent editorial source." }, "sections": [ { "id": "pct-2026-11-09-company-together-ai-opening", "heading": null, "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-opening-p01", "text": "A reader asking a newspaper a question is not buying a GPU. The reader wants a useful answer while the question still matters. The newspaper, meanwhile, needs a service it can afford to keep running. Together AI occupies the space between those two expectations: it sells the work of turning available models and computing capacity into a dependable product.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I1" ] }, { "id": "pct-2026-11-09-company-together-ai-opening-p02", "text": "Its Washington Post case study gives that proposition a concrete shape. Together reports 1.79 billion monthly input tokens, thousands of daily queries and roughly two-second model responses for Ask The Post AI. The deployment combines dedicated and serverless inference, uses Llama and Mistral models, and has fixed monthly pricing. The amount of that bill is not disclosed. These are vendor-published customer results, not an independently reproduced benchmark. [Customer case study](https://www.together.ai/customers/washington-post).", "evidence_type": "reported_fact", "source_ids": [ "S1" ], "claim_ids": [ "F1" ] }, { "id": "pct-2026-11-09-company-together-ai-opening-p03", "text": "The Post's own announcement dates the launch to November 7, 2024. [The Post’s launch announcement](https://www.washingtonpost.com/pr/2024/11/07/washington-post-launches-ask-post-ai-new-search-experience/).", "evidence_type": "reported_fact", "source_ids": [ "S2" ], "claim_ids": [ "F2" ] }, { "id": "pct-2026-11-09-company-together-ai-opening-p04", "text": "The attraction is understandable: keep more control over the model without taking on the entire job of serving it. But removing one dependency creates another. Together has to earn its place through engineering, capacity and service, while charging enough to cover them. Its new compiler and its much larger infrastructure commitments show both sides of that bargain.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I1", "I2" ] } ] }, { "id": "pct-2026-11-09-company-together-ai-capital", "heading": "A financing round is not an income statement", "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-capital-p01", "text": "On July 1, Together announced an $800 million Series C. The release carried by lead investor Aramco Ventures specified an $8.3 billion post-money valuation, thousands of paying customers and annual bookings that had crossed $1.15 billion in the previous quarter. It also described an ambition to increase the infrastructure footprint roughly fiftyfold over five years. Those are company and investor disclosures, with financial interests attached. [Financing release](https://aramcoventures.com/news/together-ai-raises-800-million-at-8-3-billion-valuation-to-make-frontier-ai-accessible-to-all/).", "evidence_type": "reported_fact", "source_ids": [ "S3" ], "claim_ids": [ "F3" ] }, { "id": "pct-2026-11-09-company-together-ai-capital-p02", "text": "Bookings deserve their own label. They are not interchangeable with recognized revenue, annual recurring revenue or cash collected. The release does not provide enough detail about contract duration, cancellation rights or the calculation to turn its headline into any of those measures. Nor does a valuation tell readers whether selling inference is already profitable. The business can be expanding rapidly while those questions remain open.", "evidence_type": "editorial_analysis", "source_ids": [ "S3" ], "claim_ids": [ "I3" ] }, { "id": "pct-2026-11-09-company-together-ai-capital-p03", "text": "CEO Vipul Ved Prakash's accompanying essay added another distinction: the company said it had secured commitments for more than 500 megawatts of compute capacity, to be capitalized independently by new investors. That is a statement about future supply and financing arrangements, not a claim that 500 megawatts were already serving customers. [July 1 company essay](https://www.together.ai/blog/announcing-our-series-c).", "evidence_type": "reported_fact", "source_ids": [ "S4" ], "claim_ids": [ "F4" ] }, { "id": "pct-2026-11-09-company-together-ai-capital-p04", "text": "Separate financing may reduce the equity Together itself must devote to physical infrastructure. It does not, by itself, disclose who bears an idle machine's cost. A buyer can rent instead of own and still have a substantial obligation to pay. The missing information is the connection between customer commitments, supplier commitments and the dates on which each becomes binding. That connection matters more to the economics than the label attached to the cloud.", "evidence_type": "editorial_analysis", "source_ids": [ "S4" ], "claim_ids": [ "I4" ] } ] }, { "id": "pct-2026-11-09-company-together-ai-ibm", "heading": "The capacity arrives on a different clock", "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-ibm-p01", "text": "IBM supplied a more specific example on August 11. The companies announced a multi-year $240 million agreement for an NVIDIA HGX B300 cluster on IBM Cloud, with availability expected in the first quarter of 2027. Together would use it for open-model inference. IBM also identified Spectrum-X networking. As of this article's November 9 observation date, this is announced future capacity, not an operational cluster verified by this reporting. [IBM announcement](https://newsroom.ibm.com/2026-08-11-IBM-and-Together-AI-Sign-Multi-Year-Agreement-to-Scale-Open-Source-AI-Inference-with-NVIDIA-AI-Infrastructure-on-IBM-Cloud).", "evidence_type": "reported_fact", "source_ids": [ "S5" ], "claim_ids": [ "F5" ] }, { "id": "pct-2026-11-09-company-together-ai-ibm-p02", "text": "The announcement does not specify the agreement's exact length, payment schedule, minimum draw or termination provisions. Dividing $240 million by an assumed number of years would manufacture an annual cost. Treating the amount as immediate expenditure, or as revenue already earned by either party, would be equally premature. A large agreement is evidence of commercial intent; its cash consequences depend on terms the release does not show.", "evidence_type": "editorial_analysis", "source_ids": [ "S5" ], "claim_ids": [ "I5" ] }, { "id": "pct-2026-11-09-company-together-ai-ibm-p03", "text": "The strategic logic is nevertheless clear. Customer-facing inference needs supply that can be counted on, and reserved supply needs customers who will use it. If those commitments line up, a specialist can combine purchasing scale with software efficiency. If customer demand changes faster than the capacity arrangement, the same structure can leave expensive resources attached to yesterday's forecast. This is a conditional business risk, not evidence that Together has excess capacity today.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I6" ] }, { "id": "pct-2026-11-09-company-together-ai-ibm-p04", "text": "There is also a timing problem distinct from demand. A customer can begin paying for an application before a planned cluster is delivered, or need more capacity while an expansion is still under construction. A credible growth story therefore needs an operating bridge between the existing fleet and the future one. An infrastructure announcement explains where additional supply is intended to come from. It does not show that bridge's cost or spare capacity.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I6" ] } ] }, { "id": "pct-2026-11-09-company-together-ai-research", "heading": "Software has to pay its way", "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-research-p01", "text": "Together's answer is not simply to acquire more GPUs. On November 4, it announced Together Compiler as part of a broader effort to adapt inference software to changing models, hardware and traffic. The company says AI agents search for faster implementations and that the compiler already supports some production serverless endpoints. Customer access was described as a limited beta; self-service optimization of dedicated deployments remained forthcoming. [November 4 announcement](https://www.together.ai/blog/polymorphic-inference).", "evidence_type": "reported_fact", "source_ids": [ "S6" ], "claim_ids": [ "F6" ] }, { "id": "pct-2026-11-09-company-together-ai-research-p02", "text": "The underlying engineering idea has a more restrained precedent. A May 27, 2025 Hazy Research post examined a single-sequence Llama-3.2-1B workload on an H100. Combining operations into one larger GPU program reduced gaps between operations; the researchers reported using 78% of memory bandwidth and beating the tested systems by more than 1.5 times. That was a narrow, disclosed experiment, not a universal inference speedup. [Research and test scope](https://hazyresearch.stanford.edu/blog/2025-05-27-no-bubbles).", "evidence_type": "reported_fact", "source_ids": [ "S8" ], "claim_ids": [ "F7" ] }, { "id": "pct-2026-11-09-company-together-ai-research-p03", "text": "The commercial interpretation is simple: more completed work from the same hardware can create room for a lower customer price, a better provider margin, or both. But the benefit must survive the actual workload. A fast result on a small model with one user does not establish the cost of serving many users, longer prompts or a different model. Efficiency is valuable precisely because it has to be achieved in specific circumstances.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I7" ] }, { "id": "pct-2026-11-09-company-together-ai-research-p04", "text": "Together's current product page says candidate optimizations are checked for speed and correctness before production use. It reports up to 2.6 times the tokens per GPU at matched per-user speed in a set of Blackwell tests, following a 24-hour compilation using two nodes per model. The page also says supported serverless customers receive compiled kernels without a price change. These are the vendor's measurements and product claims. [Compiler product details](https://www.together.ai/polymorphic-inference).", "evidence_type": "reported_fact", "source_ids": [ "S7" ], "claim_ids": [ "F8" ] }, { "id": "pct-2026-11-09-company-together-ai-research-p05", "text": "That last detail makes the business question sharper. If the customer pays the same token price and Together needs less hardware time, the provider could retain some savings. Competition could instead push the selling price down. Maintaining an advantage then requires repeated improvements, not a single published result. The research team is potentially part of the production cost structure as well as the sales story, and automation is an attempt to make that expertise serve more workloads.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I8" ] } ] }, { "id": "pct-2026-11-09-company-together-ai-pricing", "heading": "Predictability has a utilization bill", "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-pricing-p01", "text": "Together's public menu makes the software premium visible without revealing its margin. On November 9, an H100 was listed at $5.49 per GPU-hour for dedicated inference and $3.99 for on-demand GPU clusters. These are different products, not interchangeable quotes. The $1.50 difference cannot be called profit: serving software, support, configuration and underlying supply economics all matter. [Observed pricing](https://www.together.ai/pricing).", "evidence_type": "mixed_fact_and_analysis", "source_ids": [ "S9" ], "claim_ids": [ "F9", "I9" ] }, { "id": "pct-2026-11-09-company-together-ai-pricing-p02", "text": "For reserved token capacity, the documentation describes provisioned throughput units, or PTUs, at $0.05 per unit per minute. Input, output and cached tokens draw on capacity at different, model-specific rates. Unused units do not roll over or receive a refund. Commitments are tied to a model or model family; changing models requires discussion with sales. [Provisioned throughput documentation](https://docs.together.ai/docs/inference/provisioned-throughput).", "evidence_type": "reported_fact", "source_ids": [ "S10" ], "claim_ids": [ "F10" ] }, { "id": "pct-2026-11-09-company-together-ai-pricing-p03", "text": "At that published rate, one continuously reserved PTU over exactly thirty days costs $2,160 before any additional charges; ten cost $21,600. This is arithmetic, not a customer quote or a statement that one unit can run a particular application. If the same reservation serves half as much useful work, its cost per completed unit of work doubles. A predictable bill removes surprise from spending, not from demand.", "evidence_type": "calculation", "source_ids": [ "S10" ], "claim_ids": [ "I10" ] }, { "id": "pct-2026-11-09-company-together-ai-pricing-p04", "text": "The service promise also needs careful reading. Marketing uses a 99% uptime shorthand, but the documentation defines reliability as at least 99% of eligible requests completing successfully each month without a Together-caused error. Requests outside purchased capacity and stated limits are excluded. Overflow may use shared serverless capacity at standard rates, without the PTU guarantee. A request-success measure is not a promise about clock-time availability. [Product overview](https://www.together.ai/provisioned-throughput); [Detailed terms](https://docs.together.ai/docs/inference/provisioned-throughput).", "evidence_type": "mixed_fact_and_analysis", "source_ids": [ "S10", "S11" ], "claim_ids": [ "F11", "I11" ] }, { "id": "pct-2026-11-09-company-together-ai-pricing-p05", "text": "This is the practical bargain beneath the fixed bill: the customer buys a defined amount of preparedness, not an unlimited safety net. Steady traffic can make the commitment attractive. Sharp peaks can require more reserved capacity or expose overflow to a different service level. Together benefits when reservations and available machines can be planned together. The buyer benefits when the purchased shape resembles the workload. Neither side wins automatically merely because billing is predictable.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I12" ] } ] }, { "id": "pct-2026-11-09-company-together-ai-independence", "heading": "Model choice is not a finished exit plan", "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-independence-p01", "text": "The Washington Post deployment is useful because it shows an actual application rather than a hypothetical model migration. It does not establish the Post's complete unit economics. The public case study gives neither the total monthly charge nor the output-token volume and workload distribution needed to reproduce the bill. Its response-time result also does not disclose a percentile or a complete end-to-end measurement method.", "evidence_type": "source_limitations", "source_ids": [ "S1" ], "claim_ids": [ "U1" ] }, { "id": "pct-2026-11-09-company-together-ai-independence-p02", "text": "For any customer, retaining model access and retaining a cheap, fast deployment are different things. Moving a model to another provider may be possible while still requiring integration work, performance tuning and new capacity commitments. The value of a specialist is partly the work it saves. That same saved work can become work the customer must recreate when leaving. This is an operational switching cost, even without an exclusive model contract.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I13" ] }, { "id": "pct-2026-11-09-company-together-ai-independence-p03", "text": "Together therefore has a plausible position between self-operated infrastructure and a closed model API. It can sell a managed service while leaving more model choice with the customer. The durable advantage would be making that freedom economical in practice: serving the chosen model efficiently, adapting when it changes, and keeping capacity available without pricing away the benefit.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I14" ] } ] }, { "id": "pct-2026-11-09-company-together-ai-outlook", "heading": "What would make the case stronger", "paragraphs": [ { "id": "pct-2026-11-09-company-together-ai-outlook-p01", "text": "The next revealing disclosures would connect bookings to recognized revenue and cash, distinguish committed capacity from live supply, and show the cost of keeping customer promises. Research results should be followed by production economics on comparable workloads. The November compiler announcement makes the software argument more concrete; the IBM agreement makes the supply ambition more concrete. Neither, alone, proves the margin between them.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I15" ] }, { "id": "pct-2026-11-09-company-together-ai-outlook-p02", "text": "For the newspaper's reader, all of this remains backstage. A useful answer arrives, or it does not. Together's opportunity is to make that ordinary experience easier for customers to deliver at scale. Its test is to turn the engineering and capacity required for predictability into a business that is predictable enough itself.", "evidence_type": "editorial_analysis", "source_ids": [], "claim_ids": [ "I16" ] } ] } ], "word_count": 1778, "estimated_reading_minutes": 8.1, "reading_rate_words_per_minute": 220, "editorial_checks": { "prepublication_checks": [ "Use July 2026 $800m funding and explicit $8.3bn post-money valuation rather than older round.", "Call $1.15bn annual bookings as source does, not ARR or recognized revenue.", "Expected Q1 2027 IBM capacity is future, not currently operating.", "Do not divide $240m by an invented term.", "Do not equate independently financed capacity with absence of commitments.", "99% SLA is eligible-request success monthly, not clock uptime.", "Dedicated inference and cluster GPU prices are different products; spread is not margin.", "PTU arithmetic assumes precisely 30 continuous days and excludes additional charges.", "No claim that Post uses new compiler or PTUs.", "Research tests and compiler claims remain attributed and workload-limited." ], "independent_interviews_conducted": false, "hands_on_benchmarks_conducted": false, "source_date_caution": "Undated live pages use observation date, never an invented publication date.", "new_reporting_hook": "Together Compiler announcement dated 2026-11-04." }, "provenance": { "research_basis": "Public primary sources: company and investor releases, counterparty announcement, customer-origin launch notice, vendor case study, original research and live pricing/docs. No outreach, purchases or private interviews.", "factual_cutoff_date": "2026-11-09", "entity_focus": "Together AI", "previous_company_subjects_excluded": [ "SF Compute", "CoreWeave", "Crusoe", "Nebius", "Modal", "Runpod" ] }, "company_dossier": { "id": "pct-2026-11-09-company-together-ai-dossier", "content_type": "company_dossier", "schema_version": "pct-company-dossier-1.0", "publication_date": "2026-11-09", "observation_date": "2026-11-09", "parent_article_id": "pct-2026-11-09-company-together-ai", "subject": "Together AI", "source_ids": [ "S1", "S2", "S3", "S4", "S5", "S6", "S7", "S8", "S9", "S10", "S11" ], "fact_ids": [ "F1", "F2", "F3", "F4", "F5", "F6", "F7", "F8", "F9", "F10", "F11" ], "inference_ids": [ "I1", "I2", "I3", "I4", "I5", "I6", "I7", "I8", "I9", "I10", "I11", "I12", "I13", "I14", "I15", "I16" ], "uncertainty_reference": "Parent article unknowns array", "uncertainty_ids": [ "U1", "U2", "U3", "U4", "U5", "U6" ], "correction_history": [], "license_status": "Original PCT editorial text; public license not selected. Source rights remain separate.", "format_note": "Normalized dossier index into the parent article’s facts, inferences and source records; no disconnected duplicate prose." } }, "public_projection": { "version": "1.0.0", "date": "2026-11-10", "changes": [ "Internal workspace artifact paths omitted where present. Historical license/status fields retain original provenance; current public reuse policy is stated separately." ], "rights": "PCT reserves rights in original editorial content; third-party rights retained. No general source-data reuse license." } }