LowRankLayers.jl
  • Home
Version
  • Home
  • Home
GitHub

LowRankLayers

Documentation for LowRankLayers.

  • LowRankLayers.LoRADense
LowRankLayers.LoRADense — Method
LoRADense(primary::Dense, hidden_dim::Int; init=Flux.kaiming_uniform())

Create a LoRA wrapper around a Dense layer. The second projection matrix is initialized to zero, and only the two projections (and not the primary layer) are trainable.

source

Powered by Documenter.jl and the Julia Programming Language.

Settings


This document was generated with Documenter.jl version 1.8.0 on Saturday 21 December 2024. Using Julia version 1.11.2.