wab
wab — yIlaD.
{study notes}
- {Markov} QaPla': 1906 DIS vIghajta' Markov'e'. Word connection tally'e' yIjatlhbe'chugh, probability distribution yIjatlhbe'.
- Frequency table: Word-to-word connections QaPla'. Row normalize'a', next word probability distribution yIjatlhbe'.
- Sampling: Next word pick'a' context'e' lo'taHvIS. Claude je {modern language models} je sampling lo'taH.
- {Next-token prediction}: Phone'e' 2010 DIS SwiftKey je Apple QuickType lo'taHta'. Markov table lookup'e' lo'ta'pu'.
- Neural networks: 2015 DIS RNNs, 2017 DIS {transformers} table lookup replace'ta'. Learned function lo'taH.
- Personalized "Me-bot": Individual usage patterns'e' lo'taHvIS, voice personalized recommendations yIjatlhbe'. Tech magic'e' simple algorithm'e' ghaH.
- {Interpretable} generator: 100% interpretable next-token. Probabilities show'a', word choice transparent'a' ghaH.
{flashcards} 10 {cards}
{question}
yI'ang · ←/→
{answer}
{flip}
{knowledge check} 6 {questions}