Raster and Vector Comparison

Hi all,

Thanks in advance for the help. I am trying to compare two sets of geographic data, one a raster (GeoTiff) and the other a vector (3D Matrix of Lat/Lon/Elevation). I know that the vector will roughly match a section of the GeoTiff and right now I use the optimization toolbox to roughly align the vector on the raster and give me an RMS output.

Unfortunately the process does not work well unless the Vector is very close to ground truth already. Can anyone give me a recommendation for how to compare these two data sets?