Update README.md
Browse files
README.md
CHANGED
|
@@ -40,11 +40,11 @@ $$
|
|
| 40 |
|
| 41 |
|
| 42 |
where:
|
| 43 |
-
|
| 44 |
-
- x
|
| 45 |
-
-
|
| 46 |
-
-
|
| 47 |
-
|
| 48 |
|
| 49 |
$$
|
| 50 |
\Delta y = \frac{\alpha}{r} \Big( x' A_{\text{pos}} B_{\text{pos}} - \tau \, x' A_{\text{neg}} B_{\text{neg}} \Big)
|
|
|
|
| 40 |
|
| 41 |
|
| 42 |
where:
|
| 43 |
+
|
| 44 |
+
- <img src="https://latex.codecogs.com/svg.image?\;x\in\mathbb{R}^{d_{in}}\" /> is the input vector (or each sample in a batch).
|
| 45 |
+
- <img src="https://latex.codecogs.com/svg.image?\;W\in\mathbb{R}^{d_{out}\times&space;d_{in}}\" /> is the fixed pre-trained weight matrix.
|
| 46 |
+
- <img src="https://latex.codecogs.com/svg.image?\;\Delta&space;y\" /> is the differential update computed as:
|
| 47 |
+
|
| 48 |
|
| 49 |
$$
|
| 50 |
\Delta y = \frac{\alpha}{r} \Big( x' A_{\text{pos}} B_{\text{pos}} - \tau \, x' A_{\text{neg}} B_{\text{neg}} \Big)
|