When is a Jacobian Matrix not diagonal?
$begingroup$
According to this article (See: the section "Derivatives of vector element-wise binary operators"), Jacobian Matrix is nothing but a Diagonal Identity Matrix.
I am failing to understand What is so special about Jacobian Matrix then? Why don't we talk about an Identity matrix then?
When is a Jacobian Matrix not diagonal?
calculus matrices jacobian
asked Jan 1 at 8:53
user366312user366312
647317
$endgroup$
add a comment |
$begingroup$
According to this article (See: the section "Derivatives of vector element-wise binary operators"), Jacobian Matrix is nothing but a Diagonal Identity Matrix.
I am failing to understand What is so special about Jacobian Matrix then? Why don't we talk about an Identity matrix then?
When is a Jacobian Matrix not diagonal?
calculus matrices jacobian
asked Jan 1 at 8:53
user366312user366312
647317
$endgroup$
$begingroup$
your article does not say that.
$endgroup$
– dezdichado
Jan 1 at 9:31
$begingroup$
@dezdichado, see "Derivatives of vector element-wise binary operators".
$endgroup$
– user366312
Jan 1 at 9:41
add a comment |
$begingroup$
According to this article (See: the section "Derivatives of vector element-wise binary operators"), Jacobian Matrix is nothing but a Diagonal Identity Matrix.
I am failing to understand What is so special about Jacobian Matrix then? Why don't we talk about an Identity matrix then?
When is a Jacobian Matrix not diagonal?
calculus matrices jacobian
asked Jan 1 at 8:53
user366312user366312
647317
$endgroup$
According to this article (See: the section "Derivatives of vector element-wise binary operators"), Jacobian Matrix is nothing but a Diagonal Identity Matrix.
I am failing to understand What is so special about Jacobian Matrix then? Why don't we talk about an Identity matrix then?
When is a Jacobian Matrix not diagonal?
calculus matrices jacobian
calculus matrices jacobian
asked Jan 1 at 8:53
user366312user366312
647317
asked Jan 1 at 8:53
user366312user366312
647317
edited Jan 1 at 9:42
user366312
asked Jan 1 at 8:53
user366312user366312
647317
asked Jan 1 at 8:53
user366312user366312
647317
asked Jan 1 at 8:53
user366312user366312
647317
647317
$begingroup$
your article does not say that.
$endgroup$
– dezdichado
Jan 1 at 9:31
$begingroup$
@dezdichado, see "Derivatives of vector element-wise binary operators".
$endgroup$
– user366312
Jan 1 at 9:41
add a comment |
$begingroup$
your article does not say that.
$endgroup$
– dezdichado
Jan 1 at 9:31
$begingroup$
@dezdichado, see "Derivatives of vector element-wise binary operators".
$endgroup$
– user366312
Jan 1 at 9:41
$begingroup$
your article does not say that.
$endgroup$
– dezdichado
Jan 1 at 9:31
$begingroup$
your article does not say that.
$endgroup$
– dezdichado
Jan 1 at 9:31
$begingroup$
@dezdichado, see "Derivatives of vector element-wise binary operators".
$endgroup$
– user366312
Jan 1 at 9:41
$begingroup$
@dezdichado, see "Derivatives of vector element-wise binary operators".
$endgroup$
– user366312
Jan 1 at 9:41
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
From the article,
That's quite a furball, but fortunately the Jacobian is very often a
diagonal matrix, a matrix that is zero everywhere but the diagonal.
is just an empirical claim that most of the Jacobians that you meet in this domain (deep learning according to this article) are diagonal. It is not true in general.
answered Jan 1 at 9:51
twnlytwnly
1,0611213
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3058296%2fwhen-is-a-jacobian-matrix-not-diagonal%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
From the article,
That's quite a furball, but fortunately the Jacobian is very often a
diagonal matrix, a matrix that is zero everywhere but the diagonal.
is just an empirical claim that most of the Jacobians that you meet in this domain (deep learning according to this article) are diagonal. It is not true in general.
answered Jan 1 at 9:51
twnlytwnly
1,0611213
$endgroup$
add a comment |
$begingroup$
From the article,
That's quite a furball, but fortunately the Jacobian is very often a
diagonal matrix, a matrix that is zero everywhere but the diagonal.
is just an empirical claim that most of the Jacobians that you meet in this domain (deep learning according to this article) are diagonal. It is not true in general.
answered Jan 1 at 9:51
twnlytwnly
1,0611213
$endgroup$
add a comment |
$begingroup$
From the article,
That's quite a furball, but fortunately the Jacobian is very often a
diagonal matrix, a matrix that is zero everywhere but the diagonal.
is just an empirical claim that most of the Jacobians that you meet in this domain (deep learning according to this article) are diagonal. It is not true in general.
answered Jan 1 at 9:51
twnlytwnly
1,0611213
$endgroup$
From the article,
That's quite a furball, but fortunately the Jacobian is very often a
diagonal matrix, a matrix that is zero everywhere but the diagonal.
is just an empirical claim that most of the Jacobians that you meet in this domain (deep learning according to this article) are diagonal. It is not true in general.
answered Jan 1 at 9:51
twnlytwnly
1,0611213
answered Jan 1 at 9:51
twnlytwnly
1,0611213
answered Jan 1 at 9:51
twnlytwnly
1,0611213
answered Jan 1 at 9:51
twnlytwnly
1,0611213
1,0611213
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3058296%2fwhen-is-a-jacobian-matrix-not-diagonal%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
your article does not say that.
$endgroup$
– dezdichado
Jan 1 at 9:31
$begingroup$
@dezdichado, see "Derivatives of vector element-wise binary operators".
$endgroup$
– user366312
Jan 1 at 9:41