Update README.md
Browse files
README.md
CHANGED
|
@@ -39,11 +39,12 @@ y = W x + \Delta y
|
|
| 39 |
$$
|
| 40 |
|
| 41 |
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
\
|
|
|
|
| 47 |
|
| 48 |
$$
|
| 49 |
\Delta y = \frac{\alpha}{r} \Big( x' A_{\text{pos}} B_{\text{pos}} - \tau \, x' A_{\text{neg}} B_{\text{neg}} \Big)
|
|
|
|
| 39 |
$$
|
| 40 |
|
| 41 |
|
| 42 |
+
where:
|
| 43 |
+
|
| 44 |
+
- \(x \in \mathbb{R}^{d_{in}}\) is the input vector (or each sample in a batch).
|
| 45 |
+
- \(W \in \mathbb{R}^{d_{out} \times d_{in}}\) is the fixed pre-trained weight matrix.
|
| 46 |
+
- \(\Delta y\) is the differential update computed as:
|
| 47 |
+
|
| 48 |
|
| 49 |
$$
|
| 50 |
\Delta y = \frac{\alpha}{r} \Big( x' A_{\text{pos}} B_{\text{pos}} - \tau \, x' A_{\text{neg}} B_{\text{neg}} \Big)
|