torchTT

Tensor-Train decomposition package written in Python on top of pytorch. Supports GPU acceleration and automatic differentiation. It also contains routines for solving linear systems in the TT format and performing adaptive cross approximation (the AMEN solver/cross interpolation is inspired form the MATLAB TT-Toolbox). Some routines are implemented in C++ for an increased execution speed.

Installation

Requirements

• python>=3.8
• torch>=1.7.0
• numpy>=1.18
• opteinsum

Using pip

pip install torchTT

The latest github version can be installed using:

pip install git+https://github.com/ion-g-ion/torchTT

One can also clone the repository and manually install the package:

git clone https://github.com/ion-g-ion/torchTT
cd torchTT
python setup.py install

Using uv

You can install the package using uv:

uv pip install torchTT

The latest github version can be installed using:

uv pip install git+https://github.com/ion-g-ion/torchTT

One can also clone the repository and install the package using uv:

git clone https://github.com/ion-g-ion/torchTT
cd torchTT
uv sync

Or install in editable mode:

uv pip install -e .

Development Installation

For development, you may want to install the package with additional development dependencies (pytest, sphinx, ipykernel, matplotlib):

Using pip:

pip install -e ".[dev]"

Using uv:

uv sync --extra dev

uv pip install -e ".[dev]"

This will install the package in editable mode along with all development tools needed for testing, building documentation, and working with Jupyter notebooks.

Components

The main modules/submodules that can be accessed after importing torchtt are briefly desctibed in the following table. Detailed description can be found here.

| Component | Description | | --- | --- | | torchtt | Basic TT class and basic linear algebra functions. | | torchtt.solvers | Implementation of the AMEN solver. | | torchtt.grad | Wrapper for automatic differentiation. | | torchtt.manifold | Riemannian gradient and projection onto manifolds of tensors with fixed TT rank. | | torchtt.nn | Basic TT neural network layer. | | torchtt.interpolate | Cross approximation routines. |

Tests

The directory tests/ from the root folder contains all the unittests. To run them use the command:

pytest tests/

Documentation and examples

* basictutorial.py / basictutorial.ipynp: This contains a basic tutorial on decomposing full tensors in the TT format as well as performing rank rounding, slicing (Try on Google Colab). * basiclinalg.py / basiclinalg.ipynp: This tutorial presents all the algebra operations that can be performed in the TT format (Try on Google Colab). * efficientlinalg.py / efficientlinalg.ipynb: contains the DMRG for fast matves and AMEN for elementwise inversion in the TT format (Try on Google Colab). * automaticdifferentiation.py / automaticdifferentiation.ipynp: Basic tutorial on AD in torchtt (Try on Google Colab). * crossinterpolation.py / crossinterpolation.ipynb: In this script, the cross interpolation emthod is exemplified (Try on Google Colab). * systemsolvers.py / systemsolvers.ipynb: This contains the bais ussage of the multilinear solvers (Try on Google Colab). * gpuacceleration.py / gpuacceleration.ipynb: This provides an example on how to use the GPU acceleration (Try on Google Colab). * basicnn.py / basicnn.ipynb: This provides an example on how to use the TT neural network layers (Try on Google Colab). * mnistnn.py / mnistnn.ipynb: Example of TT layers used for image classification (Try on Google Colab). * manifold.py / manifold.ipynb: This demonstrates Riemannian gradient descent on manifolds of tensors with fixed TT rank (Try on Google Colab). * randomtt.py: This script shows how to generate random TT tensors with different variances (Try on Google Colab). * tensorcompletion.py: This example demonstrates tensor completion using manifold learning with Riemannian gradient descent (Try on Google Colab).

Building Documentation

make html