wab
wab — yIlaD.
{study notes}
- {Serial Position Effect}: LLM'pu' 'ej SuvwI'pu' Qapla'la' - QaPla' wa'DIch 'ej QaPla' wa'maH loS, 'ach Qapla' wa'maH vIlIj pagh. Poq 'oH middle.
- **"Lost in the Middle" (Liu et al. , 2023)**: Key facts Qapla' wa'maH loS poq'a'pu'chugh, accuracy 30%+ jatlhbe'. Qapla'be' 'oH.
- {Transformer} attention patterns: Edge'a'pu' context window'a'pu' 'aq law', middle 'aq puS. Structural 'oH, quirk'be'.
- Context engineering tension: Qapla' law' = result better'be'. Curate ruthlessly, place strategically. What include, what leave out, where put - Qapla' 'oH.
- Dangerous pattern: Key instruction middle'a'pu' bury. Model miss'a'pu' law'.
- Safer pattern: Key instruction system prompt wa'DIch'a'pu', restate end'a'pu'. Important constraint wa'DIch 'ej wa'maH loS state.
- Practical advice: Most important instruction beginning 'aq, end 'aq put. Model equal weight everything middle'a'pu' rely'be'.
- Core principle: More context ≠ better results. Attention finite 'oH. Smarter 'oH answer, more'be'.
{flashcards} 10 {cards}
{question}
yI'ang · ←/→
{answer}
{flip}
{knowledge check} 6 {questions}