demolishing my intuitions, llama.cpp only gets 8-10t/s for a 4bit 27b while bitsandbytes + transformers gets me 27t/s. what. why
Search
Best match combines word and meaning matches. Phrases, hashtags, accounts and websites guide which posts fit; timely queries also favor recent posts. Match labels describe why a post appears, not its quality or accuracy.
- @crumb.bsky.socialBluesky
- @qdrddr.bsky.socialBluesky
Any locally running #LLM to #system-1 #decisions #API. #inference Backends: #Huggingface, #llama.cpp, #vLLM, #SGLang. #Jev #OpenSource Apache 2.0 lic
github.com GitHub
- @yzma.aiBluesky
Jeyzma is like @typesafeai.bsky.social minus $870 million plus @golang.org & @tinygo.org & @hf.co llama.cpp Go make a decision! Already available right now in your browser. jeyzma.com #jev #decisionAI #browserAI #llamacpp #systemOne
jeyzma.com Jeyzma
- @lostreflector.bsky.socialBluesky
But at least AI finished it
- @zinthos.devBluesky
Zinthos Codex IV: "Tools are leverage, not identity." AI is in the kit. It isn't the personality. https://zinthos.dev #AI #BuildInPublic #XMPP
- @jesse.idBluesky
The AI Torture Chamber https://jesse.id/blog/the-ai-torture-chamber
- @xenolandscapes.comBluesky
Red green TDD, BDD, mutation testing, fuzzing, property testing and model checking if you can get it in!
- @jmiers230.bsky.socialBluesky
👇🏻👇🏻👇🏻👇🏻👇🏻👇🏻
Quoted by Michael Harris: “The result is also contained in a paper… released by OpenAI on October 6, 2026, in which the proof strategy and specific choices of notation are identical to a preliminary version of the present paper that was uploaded to ChatGPT on September 8, 2026.” siliconreckoner.substack.com/p… arxiv.org/abs/2610.10072
siliconreckoner.substack.com Now all mathematicians can be Mechanical Turks
- @amyhoy.bsky.socialBluesky
cognitive omnishambles
ai can b ur mind
- @benfulton@fosstodon.orgMastodon
Chinese Room Consider a program which receives and outputs Chinese characters so perfectly that humans cannot distinguish it from a Chinese-speaking person. Now assume you are in a room, receiving Chinese characters slipped under the door. You follow an English version of the computer program step-by-step, which instructs you to return output Chinese characters. You would not understand the conversation: similarly, the computer is not capable of understanding. en.wikipedia.org/wiki/Chinese_… #ai
en.wikipedia.org Chinese room
- @GossiTheDog@cyberplace.socialMastodon
terrytao.wordpress.com/2026/09…
terrytao.wordpress.com A Severe Misalignment of AI in Mathematics
- @mas-bandwidth.bsky.socialBluesky
Some extremely mid programmers apparently arstechnica.com/ai/2026/10/a...
arstechnica.com AI coding agents generate more code, but not more software
- @aistudio.bsky.socialBluesky
#QP Spooky #aiart #oc #SpookyTunesAI @sexyjutsuai.bsky.social @guruscorpion.bsky.social @originalvelvet.bsky.social @aiartliv.bsky.social @stumblegirl.bsky.social @nevyn79.bsky.social @cyberdreamsnight.bsky.social @ruby-crimson.bsky.social @costal-ai.bsky.social @eightbuff.com @sir-steve.bsky.social
- @thomasfuchs.atBluesky
Technobabble is alive and well
- @rauschma@fosstodon.orgMastodon
1/ @KyleOrl: “AI coding agents generate more code, but not more software” arstechnica.com/ai/2026/10/ai-… Quote: Any efficiency increased during the actual coding phase, the study authors find, is “absorbed by downstream constraints in the production process”; as “the code review process significantly increases in length, pull requests are more likely to require revisions, and reviewers leave more comments.”
arstechnica.com AI coding agents generate more code, but not more software
- @dawnxianamoon.bsky.socialBluesky
This is actually how AI destroys us.
AI has more rights than kids
- @elempeng.bsky.socialBluesky
i don't think cockroaches are conscious in a way that matters but if someone tortured one i would be extremely creeped out by that person
Search looks through the last 36 hours of public posts for your words, "exact phrases", #hashtags, @handles and websites, and also finds posts about the same thing by meaning. New posts join about every 10 minutes. We only include posts whose authors allow logged-out viewing (Bluesky) or search (Mastodon, indexable accounts), and we re-check Bluesky authors each time we show a page. Likes and follower counts never decide the order. For meaning matches, query text is turned into a fingerprint on Wildroot’s own server (EmbeddingGemma-300M); it is never sent to another service. Wildroot does not save query text to disk. Looking for posts like one you have? Similar posts. How to opt out.