scipy L-BFGS-B optimizer with different step size per dimension









up vote
0
down vote

favorite












How can I adjust the optimizer to use a different step size for each DOF? When I print the parameters the step size seems to the the same per dimension.



Any other alternative optimizer that can facilitate this?



result = minimize(
error_func,
x0,
method='L-BFGS-B',
options=
'disp': verbose,
# 'maxiter': 1000,
# 'ftol': 1.0E-8,

)









share|improve this question













migrated from stats.stackexchange.com 2 days ago


This question came from our site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.










  • 2




    took me a little while to figure out what a "spicy" optimizer was (now edited to "scipy" ...)
    – Ben Bolker
    Nov 9 at 3:14










  • hail to autocomplete!
    – El Dude
    2 days ago










  • The step-size is determined by line-search. If you are not familiar with it, don't expect it to be possible (even in theory). Intro. (also gradient-descent != L-BFGS-B)
    – sascha
    2 days ago















up vote
0
down vote

favorite












How can I adjust the optimizer to use a different step size for each DOF? When I print the parameters the step size seems to the the same per dimension.



Any other alternative optimizer that can facilitate this?



result = minimize(
error_func,
x0,
method='L-BFGS-B',
options=
'disp': verbose,
# 'maxiter': 1000,
# 'ftol': 1.0E-8,

)









share|improve this question













migrated from stats.stackexchange.com 2 days ago


This question came from our site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.










  • 2




    took me a little while to figure out what a "spicy" optimizer was (now edited to "scipy" ...)
    – Ben Bolker
    Nov 9 at 3:14










  • hail to autocomplete!
    – El Dude
    2 days ago










  • The step-size is determined by line-search. If you are not familiar with it, don't expect it to be possible (even in theory). Intro. (also gradient-descent != L-BFGS-B)
    – sascha
    2 days ago













up vote
0
down vote

favorite









up vote
0
down vote

favorite











How can I adjust the optimizer to use a different step size for each DOF? When I print the parameters the step size seems to the the same per dimension.



Any other alternative optimizer that can facilitate this?



result = minimize(
error_func,
x0,
method='L-BFGS-B',
options=
'disp': verbose,
# 'maxiter': 1000,
# 'ftol': 1.0E-8,

)









share|improve this question













How can I adjust the optimizer to use a different step size for each DOF? When I print the parameters the step size seems to the the same per dimension.



Any other alternative optimizer that can facilitate this?



result = minimize(
error_func,
x0,
method='L-BFGS-B',
options=
'disp': verbose,
# 'maxiter': 1000,
# 'ftol': 1.0E-8,

)






optimization gradient-descent scipy






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Nov 9 at 2:42









El Dude

1,61331848




1,61331848




migrated from stats.stackexchange.com 2 days ago


This question came from our site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.






migrated from stats.stackexchange.com 2 days ago


This question came from our site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.









  • 2




    took me a little while to figure out what a "spicy" optimizer was (now edited to "scipy" ...)
    – Ben Bolker
    Nov 9 at 3:14










  • hail to autocomplete!
    – El Dude
    2 days ago










  • The step-size is determined by line-search. If you are not familiar with it, don't expect it to be possible (even in theory). Intro. (also gradient-descent != L-BFGS-B)
    – sascha
    2 days ago













  • 2




    took me a little while to figure out what a "spicy" optimizer was (now edited to "scipy" ...)
    – Ben Bolker
    Nov 9 at 3:14










  • hail to autocomplete!
    – El Dude
    2 days ago










  • The step-size is determined by line-search. If you are not familiar with it, don't expect it to be possible (even in theory). Intro. (also gradient-descent != L-BFGS-B)
    – sascha
    2 days ago








2




2




took me a little while to figure out what a "spicy" optimizer was (now edited to "scipy" ...)
– Ben Bolker
Nov 9 at 3:14




took me a little while to figure out what a "spicy" optimizer was (now edited to "scipy" ...)
– Ben Bolker
Nov 9 at 3:14












hail to autocomplete!
– El Dude
2 days ago




hail to autocomplete!
– El Dude
2 days ago












The step-size is determined by line-search. If you are not familiar with it, don't expect it to be possible (even in theory). Intro. (also gradient-descent != L-BFGS-B)
– sascha
2 days ago





The step-size is determined by line-search. If you are not familiar with it, don't expect it to be possible (even in theory). Intro. (also gradient-descent != L-BFGS-B)
– sascha
2 days ago


















active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













 

draft saved


draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53225094%2fscipy-l-bfgs-b-optimizer-with-different-step-size-per-dimension%23new-answer', 'question_page');

);

Post as a guest



































active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes















 

draft saved


draft discarded















































 


draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53225094%2fscipy-l-bfgs-b-optimizer-with-different-step-size-per-dimension%23new-answer', 'question_page');

);

Post as a guest














































































Popular posts from this blog

Use pre created SQLite database for Android project in kotlin

Darth Vader #20

Ondo