Finding a logistic regression model which can achieve zero error on a training set training data for a binary...
Does Skippy chunky peanut butter contain trans fat?
Why is it that Bernie Sanders is always called a "socialist"?
Why do cars have plastic shrouds over the engine?
General past possibility with 'could'
What is the purpose of easy combat scenarios that don't need resource expenditure?
ST_Buffer in PostGIS produces different results for the same set of lines
How would an AI self awareness kill switch work?
Is using an 'empty' metaphor considered bad style?
A starship is travelling at 0.9c and collides with a small rock. Will it leave a clean hole through, or will more happen?
Does dispel magic end a master's control over their undead?
Is Krishna the only avatar among dashavatara who had more than one wife?
What is the wife of a henpecked husband called?
How to tell if a BJT is PNP or NPN by looking at the circuit?
How do you funnel food off a cutting board?
Absorbing damage with Planeswalker
Early credit roll before the end of the film
How can prove this integral
How do you voice extended chords?
Has any human ever had the choice to leave Earth permanently?
How should I handle players who ignore the session zero agreement?
Am I a Rude Number?
Words and Words with "ver-" Prefix
Is a new Boolean field better than a null reference when a value can be meaningfully absent?
What's a good word to describe a public place that looks like it wouldn't be rough?
Finding a logistic regression model which can achieve zero error on a training set training data for a binary classification problem with two features
What is the best training method for 15-30k records with 5-12 features to classify data into 2 groups?Training set as donor for test set in binary classification problembuilding a classification model for strictly binary dataHow to best to use Continuous value features with discreet values for logistic regression based binary classification problemWhy is the reconstruction error for my training set larger than my test error using PCA on the MNIST data set?Stacking models which trained by different features in a data set for a classification problemExpectation and kth factorial momentFinding value up to a constant of proportionality and Correlation Matrix questionFinding pdf with more than one random variableLikelihood of Gamma Distribution
$begingroup$
Not sure where to begin with this question, can anyone help out?
machine-learning self-study mathematical-statistics
edited 1 hour ago
Bryan Krause
697212
$endgroup$
add a comment |
$begingroup$
Not sure where to begin with this question, can anyone help out?
machine-learning self-study mathematical-statistics
edited 1 hour ago
Bryan Krause
697212
$endgroup$
add a comment |
$begingroup$
Not sure where to begin with this question, can anyone help out?
machine-learning self-study mathematical-statistics
edited 1 hour ago
Bryan Krause
697212
$endgroup$
Not sure where to begin with this question, can anyone help out?
machine-learning self-study mathematical-statistics
machine-learning self-study mathematical-statistics
edited 1 hour ago
Bryan Krause
697212
edited 1 hour ago
Bryan Krause
697212
edited 1 hour ago
Bryan Krause
697212
edited 1 hour ago
Bryan Krause
697212
edited 1 hour ago
Bryan Krause
697212
697212
asked 1 hour ago
user239276
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Logistic regression is a linear classifier, i.e. it draws a line (2D datasets) and classifies accordingly (one side is class 0, other side is class 1). So, if classes can be distinguished by a line (or hyperplane in higher dimensions), it is said that the dataset is linearly separable, though this dataset is not. One way to tackle this issue is creating new features, or applying transformations. For example, this dataset seems to be separable if you think radially, i.e. $R>alpha$, where $R$ is the radius, or distance to origin, which can be found by $R=sqrt{X_1^2+X_2^2}$. Constructing a logistic regression using this feature only, results in perfect classification.
answered 1 hour ago
gunesgunes
5,2901113
$endgroup$
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
1
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
1
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "65"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f394731%2ffinding-a-logistic-regression-model-which-can-achieve-zero-error-on-a-training-s%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Logistic regression is a linear classifier, i.e. it draws a line (2D datasets) and classifies accordingly (one side is class 0, other side is class 1). So, if classes can be distinguished by a line (or hyperplane in higher dimensions), it is said that the dataset is linearly separable, though this dataset is not. One way to tackle this issue is creating new features, or applying transformations. For example, this dataset seems to be separable if you think radially, i.e. $R>alpha$, where $R$ is the radius, or distance to origin, which can be found by $R=sqrt{X_1^2+X_2^2}$. Constructing a logistic regression using this feature only, results in perfect classification.
answered 1 hour ago
gunesgunes
5,2901113
$endgroup$
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
1
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
1
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
add a comment |
$begingroup$
Logistic regression is a linear classifier, i.e. it draws a line (2D datasets) and classifies accordingly (one side is class 0, other side is class 1). So, if classes can be distinguished by a line (or hyperplane in higher dimensions), it is said that the dataset is linearly separable, though this dataset is not. One way to tackle this issue is creating new features, or applying transformations. For example, this dataset seems to be separable if you think radially, i.e. $R>alpha$, where $R$ is the radius, or distance to origin, which can be found by $R=sqrt{X_1^2+X_2^2}$. Constructing a logistic regression using this feature only, results in perfect classification.
answered 1 hour ago
gunesgunes
5,2901113
$endgroup$
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
1
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
1
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
add a comment |
$begingroup$
Logistic regression is a linear classifier, i.e. it draws a line (2D datasets) and classifies accordingly (one side is class 0, other side is class 1). So, if classes can be distinguished by a line (or hyperplane in higher dimensions), it is said that the dataset is linearly separable, though this dataset is not. One way to tackle this issue is creating new features, or applying transformations. For example, this dataset seems to be separable if you think radially, i.e. $R>alpha$, where $R$ is the radius, or distance to origin, which can be found by $R=sqrt{X_1^2+X_2^2}$. Constructing a logistic regression using this feature only, results in perfect classification.
answered 1 hour ago
gunesgunes
5,2901113
$endgroup$
Logistic regression is a linear classifier, i.e. it draws a line (2D datasets) and classifies accordingly (one side is class 0, other side is class 1). So, if classes can be distinguished by a line (or hyperplane in higher dimensions), it is said that the dataset is linearly separable, though this dataset is not. One way to tackle this issue is creating new features, or applying transformations. For example, this dataset seems to be separable if you think radially, i.e. $R>alpha$, where $R$ is the radius, or distance to origin, which can be found by $R=sqrt{X_1^2+X_2^2}$. Constructing a logistic regression using this feature only, results in perfect classification.
answered 1 hour ago
gunesgunes
5,2901113
edited 1 hour ago
answered 1 hour ago
gunesgunes
5,2901113
answered 1 hour ago
gunesgunes
5,2901113
answered 1 hour ago
gunesgunes
5,2901113
5,2901113
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
1
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
1
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
add a comment |
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
1
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
1
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
By log-reg, do you mean a logistic regression model? Thanks for your help by the way!
$endgroup$
– user239276
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
$begingroup$
yes, sorry for ambiguity.
$endgroup$
– gunes
1 hour ago
1
1
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
$begingroup$
@gunes This might be a bit too much of an answer for a self-study question, although I don't typically police those here and am not certain where exactly the community falls on these sorts of questions besides what is included in the tag info.
$endgroup$
– Bryan Krause
1 hour ago
1
1
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
$begingroup$
(+1) It's worth noting that this is essentially using a very simple Radial Basis Network with logistic loss
$endgroup$
– Cliff AB
56 mins ago
add a comment |
Thanks for contributing an answer to Cross Validated!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f394731%2ffinding-a-logistic-regression-model-which-can-achieve-zero-error-on-a-training-s%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
