Your LLM Has a Curved Space of Paragraphs

## Your LLM Has a Curved Space of Paragraphs

## Your LLM Has a Curved Space of Paragraphs Inside a transformer, token index is a coordinate. Paragraph structure is what turns it into a metric. I spent years studying general relativity theory since the beginning of my PhD student life. One of the things that make GR different from classic mechanics is: Coordinates are not distances. In GR, you write down coordinates for events. But the distance between two events isn't a function of their coordinates alone. Instead, it might depend on the metric, which varies from place to place. This post is about an experiment I designed to look for…

Читать полностью →

Источник: Towards Data Science

Подключаюсь к источникам…

30 главных источников
о мире ИИ

Автоматический перевод, курирование и красивая подача главных статей об искусственном интеллекте.

0
статей
0
источников
9
разделов