I've entered the secretive* unofficial Gaudi Discord server, and apparently people are already doing much of what I was considering, so they may be viable products.
* not secretive
Read my opinions via the internet.










































Short-form observations.
I've entered the secretive* unofficial Gaudi Discord server, and apparently people are already doing much of what I was considering, so they may be viable products.
* not secretive
I'm reaching the level of LLM psychosis where I think I could also (have GPT-6) improve the Gaudi stack and get A100-level transformer inference performance, and also think they made insane commercial decisions by not opening the MME documentation or fixing their attention implementation.
I had GPT-6-the-questionable-ChatGPT-webUI-version review the available performance data and roofline numbers, and it thinks that they Graphcored themselves by focusing on a fancy graph compiler which didn't work for some things.
There's some work by various organizations hacking around some problems, but it didn't get into the production software, and their compiler doesn't provide enough control of the MMEs to do that much.
Interesting new-to-me blog: https://atelfo.github.io/2024/04/01/biotech-questions.html
AliExpress should set up "prediction markets" on these, so I can "trade event contracts" to make this probability more calibrated or something.

I'm not sure that's something I want to encourage.
I don't care enough about interpretability, or this work in general, to spend much time looking at the "interpretable" Qwen neurons to possibly falsify this.
Those don't have the same privileged-basis thing going on (so this is not a good comparison), so I'm going to check some other things.
I don't actually care enough because it would be annoying.
Various web projects I have put together over many years. Made with at least four different JS frameworks. Some of them are bad.




























Get updates to the blog (not experiments) in your favourite RSS reader using the RSS feed.
View some of my projects at my git hosting.