GPU based alorithm on AWS Lambda
I have a function which perform some mathematical operations and need a 16gb GPU system, But this function will not be triggered always and rest of time my system will not be in use. I came to know about AWS Lambda.
Can I run GPU based algorithm on Lambda?? So that whenever I need GPU, I will get the system on cloud. I need a little description about it.
Any help will be appreciated. Thanks in advance.
java amazon-web-services amazon-ec2 aws-lambda
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
add a comment |
I have a function which perform some mathematical operations and need a 16gb GPU system, But this function will not be triggered always and rest of time my system will not be in use. I came to know about AWS Lambda.
Can I run GPU based algorithm on Lambda?? So that whenever I need GPU, I will get the system on cloud. I need a little description about it.
Any help will be appreciated. Thanks in advance.
java amazon-web-services amazon-ec2 aws-lambda
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
add a comment |
I have a function which perform some mathematical operations and need a 16gb GPU system, But this function will not be triggered always and rest of time my system will not be in use. I came to know about AWS Lambda.
Can I run GPU based algorithm on Lambda?? So that whenever I need GPU, I will get the system on cloud. I need a little description about it.
Any help will be appreciated. Thanks in advance.
java amazon-web-services amazon-ec2 aws-lambda
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
I have a function which perform some mathematical operations and need a 16gb GPU system, But this function will not be triggered always and rest of time my system will not be in use. I came to know about AWS Lambda.
Can I run GPU based algorithm on Lambda?? So that whenever I need GPU, I will get the system on cloud. I need a little description about it.
Any help will be appreciated. Thanks in advance.
java amazon-web-services amazon-ec2 aws-lambda
java amazon-web-services amazon-ec2 aws-lambda
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
asked Sep 28 '18 at 11:16
Amar MalikAmar Malik
479
479
add a comment |
add a comment |
3 Answers
3
active
oldest
votes
You can't specify the runtime environment for AWS Lambda functions, so no, you can't require the presence of a GPU (in fact the physical machines AWS chooses to put into its Lambda pool will almost certainly not have one).
Your best bet would be to run the GPU-requiring function as a Batch job on a compute cluster configured to use p-type instances. The guide here might be helpful.
answered Sep 28 '18 at 11:23
StephenStephen
55125
add a comment |
Currently lambda doesn't have GPU.
However, if you just need to do inference; the emulation via CPU works fine on AWS lambda; here is an article that goes into more details:
https://aws.amazon.com/blogs/machine-learning/how-to-deploy-deep-learning-models-with-aws-lambda-and-tensorflow/
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
add a comment |
Batch is a good solution for certain types of workload.
Another option is GPUs on ECS, which could be used for running frequent tasks utilising GPU.
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f52554184%2fgpu-based-alorithm-on-aws-lambda%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
3 Answers
3
active
oldest
votes
3 Answers
3
active
oldest
votes
active
oldest
votes
active
oldest
votes
You can't specify the runtime environment for AWS Lambda functions, so no, you can't require the presence of a GPU (in fact the physical machines AWS chooses to put into its Lambda pool will almost certainly not have one).
Your best bet would be to run the GPU-requiring function as a Batch job on a compute cluster configured to use p-type instances. The guide here might be helpful.
answered Sep 28 '18 at 11:23
StephenStephen
55125
add a comment |
You can't specify the runtime environment for AWS Lambda functions, so no, you can't require the presence of a GPU (in fact the physical machines AWS chooses to put into its Lambda pool will almost certainly not have one).
Your best bet would be to run the GPU-requiring function as a Batch job on a compute cluster configured to use p-type instances. The guide here might be helpful.
answered Sep 28 '18 at 11:23
StephenStephen
55125
add a comment |
You can't specify the runtime environment for AWS Lambda functions, so no, you can't require the presence of a GPU (in fact the physical machines AWS chooses to put into its Lambda pool will almost certainly not have one).
Your best bet would be to run the GPU-requiring function as a Batch job on a compute cluster configured to use p-type instances. The guide here might be helpful.
answered Sep 28 '18 at 11:23
StephenStephen
55125
You can't specify the runtime environment for AWS Lambda functions, so no, you can't require the presence of a GPU (in fact the physical machines AWS chooses to put into its Lambda pool will almost certainly not have one).
Your best bet would be to run the GPU-requiring function as a Batch job on a compute cluster configured to use p-type instances. The guide here might be helpful.
answered Sep 28 '18 at 11:23
StephenStephen
55125
answered Sep 28 '18 at 11:23
StephenStephen
55125
answered Sep 28 '18 at 11:23
StephenStephen
55125
answered Sep 28 '18 at 11:23
StephenStephen
55125
55125
add a comment |
add a comment |
Currently lambda doesn't have GPU.
However, if you just need to do inference; the emulation via CPU works fine on AWS lambda; here is an article that goes into more details:
https://aws.amazon.com/blogs/machine-learning/how-to-deploy-deep-learning-models-with-aws-lambda-and-tensorflow/
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
add a comment |
Currently lambda doesn't have GPU.
However, if you just need to do inference; the emulation via CPU works fine on AWS lambda; here is an article that goes into more details:
https://aws.amazon.com/blogs/machine-learning/how-to-deploy-deep-learning-models-with-aws-lambda-and-tensorflow/
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
add a comment |
Currently lambda doesn't have GPU.
However, if you just need to do inference; the emulation via CPU works fine on AWS lambda; here is an article that goes into more details:
https://aws.amazon.com/blogs/machine-learning/how-to-deploy-deep-learning-models-with-aws-lambda-and-tensorflow/
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
Currently lambda doesn't have GPU.
However, if you just need to do inference; the emulation via CPU works fine on AWS lambda; here is an article that goes into more details:
https://aws.amazon.com/blogs/machine-learning/how-to-deploy-deep-learning-models-with-aws-lambda-and-tensorflow/
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
answered Nov 15 '18 at 6:01
NeilNeil
1,42711524
1,42711524
add a comment |
add a comment |
Batch is a good solution for certain types of workload.
Another option is GPUs on ECS, which could be used for running frequent tasks utilising GPU.
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
add a comment |
Batch is a good solution for certain types of workload.
Another option is GPUs on ECS, which could be used for running frequent tasks utilising GPU.
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
add a comment |
Batch is a good solution for certain types of workload.
Another option is GPUs on ECS, which could be used for running frequent tasks utilising GPU.
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
Batch is a good solution for certain types of workload.
Another option is GPUs on ECS, which could be used for running frequent tasks utilising GPU.
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
answered Sep 28 '18 at 14:20
Matt DMatt D
1,7121617
1,7121617
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f52554184%2fgpu-based-alorithm-on-aws-lambda%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
