Finding Dimensionality in Large Data

Image credit: Tensorflow Embedding Projector

The “intrinsic” dimensionality of a dataset is a quantity of great interest in the machine learning community. There are many techniques aimed at estimating this “intrinsic” dimensionality, but there are currently none which have demonstrated scalability to large, complex datasets. In this project we aim to find the intrinsic dimension of both small and large, simple and complex datasets.