Tangent is a new, free, and open-source Python library for automatic differentiation. Existing libraries implement automatic differentiation by tracing a program's execution (at runtime, like PyTorch) ...
Currently, we directly backpropagate through the tangent vector field calculation, which involves a Newton solve to find the minimum of a convex quadratic objective. It may be more efficient to define ...