TIBCO Spotfire Community

Welcome to TIBCO Spotfire Community Sign in | Join | Help

Improvements to K-Means Clustering and Line Similarity

When looking at a line chart in Spotfire you can use K-Means or Line Similarity tools to find clusters or patterns or matching trends respectively. In 3.1, Euclidian Distance has been added as an optional similarity measure to use when performing K-Means Clustering or Line Similarity calculations. Previously, K-Means and Line Similarity only supported correlation for finding patterns which meant that similarity of trends was judged based on the relative shape of the lines no matter how far apart they might have been by the Y-axis. Now that Euclidian Distance is offered, you can cluster or seek similar trends based on their nearness to one another in Y-axis space.  See the illustrations below based on the Line Similarity tool:

We start with thousands of trends, but one particular trend is of interest and we want to find out which other trend line are most similar to the target trend.

euc_start 

 

Go to Tools > Options and run the Line Similarity tool.  If you choose “Correlation” as a similarity metric, then similarity is judged based on the shape of the line.  Here is what the plot looks like after filtering down to the top 10 results using this method.

euc_corr

 

But if you choose the new Euclidian Distance similarity option in 3.1 the top 10 most similar results to the target trend will be based on nearness rather than shape. You can see that the trends are not necessarily shaped exactly similar to the target trend, but they are located closely to the target trend.

euc_euc

Published Mar 08 2010, 06:19 PM by Brendan Gibson Rating:
Comments
 

Gerrys Blog » Blog Archive » What Can SEO Services Do For You? said:

Pingback from  Gerrys Blog  » Blog Archive   » What Can SEO Services Do For You?

March 8, 2010 10:55 PM
 

Forex Pips, Fx Charts and Trends | Insider Forex Secrets Guide said:

Pingback from  Forex Pips, Fx Charts and Trends | Insider Forex Secrets Guide

March 9, 2010 5:28 AM

About Brendan Gibson

Brendan is a Senior Product Manager with Spotfire focusing on Professional and Web Player products, and has been with Spotfire since 2002. He holds a B.A. in Biology from Yale University and an M.S. in Bioinformatics from Boston University.