the.com/embedding
turning meaning into coordinates so a machine can tell love is closer to obsession than to spreadsheet.
means a way of representing words, images, or anything else as a list of numbers so that similar things end up near each other in space.
from grew out of 1950s linguistics ideas that words are defined by their company, formalized by word2vec in 2013 when google researchers showed you could turn a dictionary into geometry.
famous equationking minus man plus woman equals queen
dimensions typicaloften 300 to 4000 numbers per item
not human madethe model invents the coordinate system itself
powers searchlets you search by meaning, not keywords
for instance
word2vec — google 2013, sparked the modern embedding boom
clip — openai 2021, embeds images and text into one shared space
openai text-embedding-3 — powers semantic search in countless apps today
spotify song embeddings — maps songs by vibe, not genre tags