Cosine Similarity
Cosine similarity is a mathematical metric used to measure the similarity between two vectors in a multi-dimensional space. It calculates the cosine of the angle between two vectors, producing a value between -1 and 1, where 1 indicates identical direction, 0 indicates orthogonality, and -1 indicates opposite direction. In AI and machine learning, cosine similarity is the most common method for comparing embeddings, which are numerical representations of text, images, or other data. It is widely used in semantic search, document similarity, recommendation systems, and clustering. Unlike Euclidean distance, cosine similarity is invariant to the magnitude of vectors, meaning it focuses on the direction or orientation of the data rather than its absolute value. This makes it particularly useful for comparing text embeddings where the length of the document should not affect the similarity measurement.
In Financial Services
Real-World Example
An investment bank implements a semantic search system using cosine similarity for its research repository. When a portfolio manager searches for "central bank digital currency impact on European banks," the system converts the query into an embedding vector and computes cosine similarity against 100,000 pre-computed document embeddings. The system returns the top 20 documents with the highest cosine similarity scores, including documents that discuss CBDC, digital euro, and fintech disruption in European banking. The system correctly captures semantic similarity even when the documents use different terminology than the query, such as those mentioning "digital currency" or "CBDC" instead of "central bank digital currency."
Why It Matters for Finance
Cosine similarity is the foundation of semantic search and retrieval in financial AI systems. Its ability to measure semantic similarity regardless of exact terminology makes it essential for building RAG systems that can find relevant information across diverse financial documents. The accuracy of cosine similarity comparisons directly impacts the quality of AI-generated answers in financial applications, making the choice of embedding model and similarity metric a critical architectural decision.
Related Terms
Explore in Finatune
Frequently Asked Questions
What is cosine similarity in financial AI?
Cosine similarity is a mathematical metric that measures the similarity between two vectors by calculating the cosine of the angle between them. In financial AI, it is used to compare embeddings for semantic search, document similarity, and recommendation systems, enabling systems to find conceptually related content even when different terminology is used.
How does cosine similarity differ from Euclidean distance?
Cosine similarity measures the angle between vectors and is invariant to magnitude, meaning it focuses on the direction of the data. Euclidean distance measures the straight-line distance between points and is affected by magnitude. For text comparison, cosine similarity is generally preferred because document length should not affect similarity measurement.
Why is cosine similarity important for RAG systems in finance?
RAG systems retrieve relevant documents by comparing the embedding of a user query against stored document embeddings using cosine similarity. Accurate cosine similarity comparisons ensure that the most relevant financial documents are retrieved to provide context for the LLM, directly impacting the quality and accuracy of AI-generated answers.