mia (developer mode) (@mia)

smh coping with “AI mode” because web search is crippled to uselessness now and the problem is out of scope for yandex

well i guess that’s actually a good use of transformer models though. you load up the context window with the initial prompt and add weights to the tokens to zero in on the result. technically that’s almost like classic search engines before they got too smart, except instead of entering search terms you’re using a natural language interface to construct a context lens that converges on a chat reply matching certain language patterns rather than specific texts

it’s a good use because you can search for something using expressions that aren’t found anywhere in or around the resource you’re looking for but still arrive at unambiguous results, and then do follow-up queries taking into account the contents

apparently this is also how i learn about math topics now because “i want to implement this for a personal project; walk me through it like i’m someone whose language processing is more activated than abstract reasoning during problem solving and who is more motivated by immediate tangible rewards than interesting theoretical concepts but still enjoys taking apart and learning how and why things work, and give me little exercises in C where i fill in the blanks” is something transformers can actually do way better than any of the math teachers i have had the misfortune to meet and any of the written lecture i was able to find.

this is empowering and i wish we’d at least see more of this than the slop that results whenever people use AI as a substitute for their own effort