![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/2026/10/CleanShot-2026-10-15-at-6.45.19-PM.gif\")
by now, most people should be aware that we're in a cost of compute crisis. The cost of CPU and memory is through the roof. There just isn't enough. Meanwhile, there definitely aren't enough GPUs in the world.
\nIf you've been using ChatGPT lately, you might have seen the meme circulating in the space that OpenAI just doesn't have enough inferencing capacity. Heck, even Tibo admits publicly that they're having compute issues.
\n\n\nIt’s the compute that is cooked
\n— Tibo (@thsottiaux) October 6, 2026
\n
In the last couple of weeks, I have lost so much time babysitting agents because of inferencing capacity issues, and it's got me wondering: what if inferencing capacity constraints were region-based? Last year, before this crunch, even with Anthropic models, inferencing was noticeably faster in Australia because everyone else in America was sleeping.
\nDay to day, I do all my open-source software development on bare-metal machines in Germany, and I've started to notice similar patterns when Europe wakes up: all of a sudden, inferencing performance plummets and I'm being greeted with walls of 'model is at capacity, try again' errors.
\n
Above is what I woke up to this morning. Imagine my dismay at losing time on a strict get-overalls-done-and-released-before-my-conference-talk timeframe. You can complain online all you want, but we're software engineers. We can solve these problems.
\nThe first piece of the puzzle is a piece of software that I wrote last month called Underclass. Underclass pools many ChatGPT subscriptions together and works as a proxy. It can automatically claim resets and correctly handles the prompt cache key to ensure usage isn't wasted.
\n![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/size/w2400/2026/10/CleanShot-2026-10-17-at-6.20.12-PM@2x.png\")
I haven't written about it before, but it is now a month old, and I consider it stable. It's available on GitHub, and I use it with six ChatGPT 500 accounts, but there's no real upper limit on how many accounts you can configure.
\n\nunderclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the ea…
\n![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/icon/favicon-aea76f9c-44c9-49d3-a1a5-a9a9ba062525.png\"){kind=icon}
![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/thumbnail/underclass-f93661a6-b274-450d-b3b6-20a3ef696782.png\")
Installation is easy, and it's well documented. It's also available as a Nix Flake.
\nAnother piece of software I wrote last month is a local LLM proxy that scans requests and attachments for secrets and proactively scrubs and redacts them before they hit the model. It's on GitHub (below)
\n\nA local proxy that scans LLM requests and attachments for secrets before they reach the model. - ghuntley/preflight
\n![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/icon/favicon-0b2813e7-01d6-4378-8639-e44757c71541.png\"){kind=icon}
To use Preflight, run a single instance of Preflight and one instance of Underclass, then point Underclass to use Preflight. Preflight scrubs requests and sends them out for inference, ensuring sensitive material never reaches the inference providers.
\n![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/2026/10/CleanShot-2026-10-17-at-6.28.31-PM@2x.png\")
By now you're probably wondering either, "Wow, that's two really cool projects," or why I opened with geographic routing. It's because... today I'm releasing a new experimental prototype called geoclass which routes your requests to different inferencing regions around the world. Like underclass and preflight, it is composable. You can use all of them, none of them, or any combination you can imagine, since they are separate pieces of software that compose well together.
How it works is simple.
\nSet up a Tailscale network and deploy virtual machines around the world, then tag those virtual machines with a Tailscale tag; GeoClass can then identify these machines via the tag. From that point forward, all you need to do is point UnderClass to GeoClass, and the rest just works (in theory!).
\n![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/size/w2400/2026/10/Screenshot-2026-10-17-at-6.55.27---PM.png\")
I don't know yet if geoclass will solve my inferencing woes, but there's also no way in hell I'm going to sit here and stew when the performance of OpenAI in Europe has been miserable over the last 30 days.
So I'm going to try experimenting with geo-routing. If the below works for you, let me know; I'm keen to catch up with folks thinking along the same wavelength. You never know until you try!
\n\n[experimental] Geo-aware egress router for underclass: retries OpenAI capacity errors in another region over a Tailscale mesh, keeping prompt caches warm - ghuntley/geoclass
\n![\"\"](\"https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/icon/favicon-a6233f77-bb91-4153-ad02-6d008cf5526c.png\"){kind=icon}
ps. socials
\n\n\n", "content_markdown": "by now, most people should be aware that we're in a cost of compute crisis. The cost of CPU and memory is through the roof. There just isn't enough. Meanwhile, there definitely aren't enough GPUs in the world.\n\nIf you've been using ChatGPT lately, you might have seen the meme circulating in the space that OpenAI just doesn't have enough inferencing capacity. Heck, even Tibo admits publicly that they're having compute issues.\n\n> It’s the compute that is cooked\n>\n> — Tibo (@thsottiaux) [October 6, 2026](https://x.com/thsottiaux/status/2107586339860631980?ref_src=twsrc%5Etfw&ref=ghuntley.com)\n\nIn the last couple of weeks, I have lost so much time babysitting agents because of inferencing capacity issues, and it's got me wondering: what if inferencing capacity constraints were region-based? Last year, before this crunch, even with Anthropic models, inferencing was noticeably faster in Australia because everyone else in America was sleeping.\n\nDay to day, I do all my open-source software development on bare-metal machines in Germany, and I've started to notice similar patterns when Europe wakes up: all of a sudden, inferencing performance plummets and I'm being greeted with walls of 'model is at capacity, try again' errors.\n\n\n\nAbove is what I woke up to this morning. Imagine my dismay at losing time on a strict get-overalls-done-and-released-before-my-conference-talk timeframe. You can complain online all you want, but we're software engineers. We can solve these problems.\n\n## underclass\n\nThe first piece of the puzzle is a piece of software that I wrote last month called Underclass. Underclass pools many ChatGPT subscriptions together and works as a proxy. It can automatically claim resets and correctly handles the prompt cache key to ensure usage isn't wasted.\n\n\n\nI haven't written about it before, but it is now a month old, and I consider it stable. It's available on GitHub, and I use it with six ChatGPT 500 accounts, but there's no real upper limit on how many accounts you can configure.\n\n[GitHub - ghuntley/underclass: underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.](https://github.com/ghuntley/underclass?ref=ghuntley.com)\n\nunderclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the ea…\n\nGitHub\n\n\n\nInstallation is easy, and it's well documented. It's also available as a Nix Flake.\n\n## preflight\n\nAnother piece of software I wrote last month is a local LLM proxy that scans requests and attachments for secrets and proactively scrubs and redacts them before they hit the model. It's on GitHub (below)\n\n[GitHub - ghuntley/preflight: A local proxy that scans LLM requests and attachments for secrets before they reach the model.](https://github.com/ghuntley/preflight?ref=ghuntley.com)\n\nA local proxy that scans LLM requests and attachments for secrets before they reach the model. - ghuntley/preflight\n\nGitHub\n\n\n\nTo use Preflight, run a single instance of Preflight and one instance of Underclass, then point Underclass to use Preflight. Preflight scrubs requests and sends them out for inference, ensuring sensitive material never reaches the inference providers.\n\n\n\n## unburying the lede\n\nBy now you're probably wondering either, \"Wow, that's two really cool projects,\" or why I opened with geographic routing. It's because... today I'm releasing a new *experimental prototype* called `geoclass` which routes your requests to different inferencing regions around the world. Like underclass and preflight, it is composable. You can use all of them, none of them, or any combination you can imagine, since they are separate pieces of software that compose well together.\n\nHow it works is simple.\n\nSet up a Tailscale network and deploy virtual machines around the world, then tag those virtual machines with a Tailscale tag; GeoClass can then identify these machines via the tag. From that point forward, all you need to do is point UnderClass to GeoClass, and the rest just works (in theory!).\n\n\n\nI don't know *yet* if `geoclass` will solve my inferencing woes, but there's also no way in hell I'm going to sit here and stew when the performance of OpenAI in Europe has been miserable over the last 30 days.\n\nSo I'm going to try experimenting with geo-routing. If the below works for you, let me know; I'm keen to catch up with folks thinking along the same wavelength. You never know until you try!\n\n[GitHub - ghuntley/geoclass: \\[experimental\\] Geo-aware egress router for underclass: retries OpenAI capacity errors in another region over a Tailscale mesh, keeping prompt caches warm](https://github.com/ghuntley/geoclass?ref=ghuntley.com)\n\n\\[experimental\\] Geo-aware egress router for underclass: retries OpenAI capacity errors in another region over a Tailscale mesh, keeping prompt caches warm - ghuntley/geoclass\n\nGitHub\n\n\n\nps. socials\n\n> 🗞️ pooling OpenAI subscriptions and bypassing regional inference capacity limits [https://t.co/s10AD5O5Vb](https://t.co/s10AD5O5Vb?ref=ghuntley.com)\n>\n> today I'm releasing a new experimental prototype called geoclass, which routes your requests to different inference regions around the world.\n>\n> set up a Tailscale network… [pic.twitter.com/2htIMiUdD3](https://t.co/2htIMiUdD3?ref=ghuntley.com)\n>\n> — geoff (@GeoffreyHuntley) [October 17, 2026](https://x.com/GeoffreyHuntley/status/2111367787629195767?ref_src=twsrc%5Etfw&ref=ghuntley.com)\n", "dateCreated": "2026-10-17T09:13:01.651988366+00:00", "date_created": "2026-10-17T08:01:21+00:00", "date_modified": "2026-10-17T08:01:21+00:00", "date_published": "2026-10-17T08:01:21+00:00", "description": "by now, most people should be aware that we're in a cost of compute crisis. The cost of CPU and memory is through the roof. There just isn't enough. Meanwhile, there definitely aren't enough GPUs in the world. If you've been using", "external_url": "https://ghuntley.com/underclass/", "git": { "commit": "ebb0941c5c06a2ab2377342d607535262a3e969e", "path": "items/ghuntley-com/2026/10/2026-10-17-pooling-openai-subscriptions-and-bypassing-regional.md", "permalink": "https://github.com/aymericbeaumet/aggr-instance/blob/ebb0941c5c06a2ab2377342d607535262a3e969e/items/ghuntley-com/2026/10/2026-10-17-pooling-openai-subscriptions-and-bypassing-regional.md" }, "id": "urn:aggr:item:782958cfc49485bed5a6c8a0d0618e0c5c9d059b", "isBasedOn": { "@id": "https://ghuntley.com/underclass/" }, "mainEntity": { "@id": "https://ghuntley.com/underclass/", "@type": "CreativeWork", "archivedAt": { "@id": "https://aggr.aymericbeaumet.com/items/ghuntley-com/2026-10-17-pooling-openai-subscriptions-and-bypassing-regional/#webpage" }, "author": [ { "@type": "Person", "name": "Geoffrey Huntley" } ], "dateModified": "2026-10-17T08:01:21+00:00", "datePublished": "2026-10-17T08:01:21+00:00", "headline": "pooling OpenAI subscriptions and bypassing regional inference capacity limits", "image": { "@type": "ImageObject", "caption": "pooling OpenAI subscriptions and bypassing regional inference capacity limits", "height": 90, "url": "https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/2026/10/Traditional-tattoo-art-print-from-a-bird---s-eye-view--depicting-pooled-OpenAI-subscriptions-as-a-collaborative-network-overcoming-regional-inference-limits.-Interwoven-streams-of-glowing-data-form-a-swirling-ornamental-tapestry--with-each-.jpg", "width": 160 }, "timeRequired": "PT4M", "url": "https://ghuntley.com/underclass/", "wordCount": 823 }, "name": "Archived snapshot: pooling OpenAI subscriptions and bypassing regional inference capacity limits", "preview": { "alt": "pooling OpenAI subscriptions and bypassing regional inference capacity limits", "color": null, "height": 90, "placeholder": { "data_url": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mNk+A8AAQUBAScY42YAAAAASUVORK5CYII=", "hash": "" }, "url": "https://storage.ghost.io/c/06/e5/06e5d12b-0328-469d-a0d0-3a0f0ba34c46/content/images/2026/10/Traditional-tattoo-art-print-from-a-bird---s-eye-view--depicting-pooled-OpenAI-subscriptions-as-a-collaborative-network-overcoming-regional-inference-limits.-Interwoven-streams-of-glowing-data-form-a-swirling-ornamental-tapestry--with-each-.jpg", "width": 160 }, "reading_minutes": 4, "replicated_at": null, "source": "ghuntley-com", "source_name": "Geoffrey Huntley", "summary": "by now, most people should be aware that we're in a cost of compute crisis. The cost of CPU and memory is through the roof. There just isn't enough. Meanwhile, there definitely aren't enough GPUs in the world. If you've been using", "tags": [ "ai" ], "temporalCoverage": "2026-10-17T09:13:01.651988366+00:00", "title": "pooling OpenAI subscriptions and bypassing regional inference capacity limits", "url": "https://aggr.aymericbeaumet.com/items/ghuntley-com/2026-10-17-pooling-openai-subscriptions-and-bypassing-regional/", "word_count": 823 }🗞️ pooling OpenAI subscriptions and bypassing regional inference capacity limits https://t.co/s10AD5O5Vb
\ntoday I'm releasing a new experimental prototype called geoclass, which routes your requests to different inference regions around the world.
\nset up a Tailscale network… pic.twitter.com/2htIMiUdD3
\n— geoff (@GeoffreyHuntley) October 17, 2026
\n