How to use Regular Expression in AWS CLI Filter
I am using AWS Command Line Interface (CLI) to list some AMI Images from AWS.
The Name of an Image is like:
XY_XYZ_Docker_1.13_XYZ_XXYY
When using
aws ec2 describe-images --filters 'Name=name,Values="*_Docker_1.13_*"'
it works as expected.
Now i want to use Regular Expression instead of static value for the Name-Filter.
In the AWS-Docs I read that filtering by RegEx is possible
My approach is:
1:
aws ec2 describe-images --filters 'Name=name,Values="[_]Docker[_][0-9][.][0-9]2[_]"'
The result is always null for this. I tried different ways of quoting the RegEx.
2:
[_]Docker[_][0-9][.][0-9]2[_]
(without quotes) leads to
Error parsing parameter '--filters': Expected: ',', received: 'D' for input:
Name=name,Values=[]Docker[][0-9][.][0-9]2[_]
3:
*[_]Docker[_][0-9][.][0-9]2[_]*
(with Asterisk) leads to
Error parsing parameter '--filters': Expected: ',', received: ']' for input:
Name=name,Values=[_]Docker[_][0-9][.][0-9]2[_]
amazon-web-services command-line-interface
add a comment |
I am using AWS Command Line Interface (CLI) to list some AMI Images from AWS.
The Name of an Image is like:
XY_XYZ_Docker_1.13_XYZ_XXYY
When using
aws ec2 describe-images --filters 'Name=name,Values="*_Docker_1.13_*"'
it works as expected.
Now i want to use Regular Expression instead of static value for the Name-Filter.
In the AWS-Docs I read that filtering by RegEx is possible
My approach is:
1:
aws ec2 describe-images --filters 'Name=name,Values="[_]Docker[_][0-9][.][0-9]2[_]"'
The result is always null for this. I tried different ways of quoting the RegEx.
2:
[_]Docker[_][0-9][.][0-9]2[_]
(without quotes) leads to
Error parsing parameter '--filters': Expected: ',', received: 'D' for input:
Name=name,Values=[]Docker[][0-9][.][0-9]2[_]
3:
*[_]Docker[_][0-9][.][0-9]2[_]*
(with Asterisk) leads to
Error parsing parameter '--filters': Expected: ',', received: ']' for input:
Name=name,Values=[_]Docker[_][0-9][.][0-9]2[_]
amazon-web-services command-line-interface
Would you consider piping the output of the AWS CLI to something likegrep
, and then using that tool's regular expression support?
– Adil B
Nov 14 '18 at 15:04
I do not want to do that because I have some more filters and the Filter by name needs to be at the beginning
– uwieuwe4
Nov 14 '18 at 15:15
The AWS CLI uses JMESPath. See: JMESPath Tutorial
– John Rotenstein
Nov 15 '18 at 5:56
add a comment |
I am using AWS Command Line Interface (CLI) to list some AMI Images from AWS.
The Name of an Image is like:
XY_XYZ_Docker_1.13_XYZ_XXYY
When using
aws ec2 describe-images --filters 'Name=name,Values="*_Docker_1.13_*"'
it works as expected.
Now i want to use Regular Expression instead of static value for the Name-Filter.
In the AWS-Docs I read that filtering by RegEx is possible
My approach is:
1:
aws ec2 describe-images --filters 'Name=name,Values="[_]Docker[_][0-9][.][0-9]2[_]"'
The result is always null for this. I tried different ways of quoting the RegEx.
2:
[_]Docker[_][0-9][.][0-9]2[_]
(without quotes) leads to
Error parsing parameter '--filters': Expected: ',', received: 'D' for input:
Name=name,Values=[]Docker[][0-9][.][0-9]2[_]
3:
*[_]Docker[_][0-9][.][0-9]2[_]*
(with Asterisk) leads to
Error parsing parameter '--filters': Expected: ',', received: ']' for input:
Name=name,Values=[_]Docker[_][0-9][.][0-9]2[_]
amazon-web-services command-line-interface
I am using AWS Command Line Interface (CLI) to list some AMI Images from AWS.
The Name of an Image is like:
XY_XYZ_Docker_1.13_XYZ_XXYY
When using
aws ec2 describe-images --filters 'Name=name,Values="*_Docker_1.13_*"'
it works as expected.
Now i want to use Regular Expression instead of static value for the Name-Filter.
In the AWS-Docs I read that filtering by RegEx is possible
My approach is:
1:
aws ec2 describe-images --filters 'Name=name,Values="[_]Docker[_][0-9][.][0-9]2[_]"'
The result is always null for this. I tried different ways of quoting the RegEx.
2:
[_]Docker[_][0-9][.][0-9]2[_]
(without quotes) leads to
Error parsing parameter '--filters': Expected: ',', received: 'D' for input:
Name=name,Values=[]Docker[][0-9][.][0-9]2[_]
3:
*[_]Docker[_][0-9][.][0-9]2[_]*
(with Asterisk) leads to
Error parsing parameter '--filters': Expected: ',', received: ']' for input:
Name=name,Values=[_]Docker[_][0-9][.][0-9]2[_]
amazon-web-services command-line-interface
amazon-web-services command-line-interface
asked Nov 14 '18 at 14:49
uwieuwe4uwieuwe4
4812
4812
Would you consider piping the output of the AWS CLI to something likegrep
, and then using that tool's regular expression support?
– Adil B
Nov 14 '18 at 15:04
I do not want to do that because I have some more filters and the Filter by name needs to be at the beginning
– uwieuwe4
Nov 14 '18 at 15:15
The AWS CLI uses JMESPath. See: JMESPath Tutorial
– John Rotenstein
Nov 15 '18 at 5:56
add a comment |
Would you consider piping the output of the AWS CLI to something likegrep
, and then using that tool's regular expression support?
– Adil B
Nov 14 '18 at 15:04
I do not want to do that because I have some more filters and the Filter by name needs to be at the beginning
– uwieuwe4
Nov 14 '18 at 15:15
The AWS CLI uses JMESPath. See: JMESPath Tutorial
– John Rotenstein
Nov 15 '18 at 5:56
Would you consider piping the output of the AWS CLI to something like
grep
, and then using that tool's regular expression support?– Adil B
Nov 14 '18 at 15:04
Would you consider piping the output of the AWS CLI to something like
grep
, and then using that tool's regular expression support?– Adil B
Nov 14 '18 at 15:04
I do not want to do that because I have some more filters and the Filter by name needs to be at the beginning
– uwieuwe4
Nov 14 '18 at 15:15
I do not want to do that because I have some more filters and the Filter by name needs to be at the beginning
– uwieuwe4
Nov 14 '18 at 15:15
The AWS CLI uses JMESPath. See: JMESPath Tutorial
– John Rotenstein
Nov 15 '18 at 5:56
The AWS CLI uses JMESPath. See: JMESPath Tutorial
– John Rotenstein
Nov 15 '18 at 5:56
add a comment |
1 Answer
1
active
oldest
votes
I wasn't able to find if Jmespath or the --filters flag can support regex, so instead I just piped to Python to run through regex.
aws ec2 describe-images --filters 'Name=name,Values="*Docker*"' |
python -c '
import json, sys, re
obj = json.load(sys.stdin)
matched_images = "Images":
for image in obj["Images"]:
if len(re.findall(r"[Dd]ockers?[0-9][.][0-9]2", image["Name"])) > 0:
matched_images["Images"].append(image)
print json.dumps(matched_images)
'
You can pipe the output (which is just a JSON string) to your next bash command if needed with a pipe character following the closing quote. Maybe this can address concerns with using grep since it returns a JSON string instead or regular text.
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53302912%2fhow-to-use-regular-expression-in-aws-cli-filter%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I wasn't able to find if Jmespath or the --filters flag can support regex, so instead I just piped to Python to run through regex.
aws ec2 describe-images --filters 'Name=name,Values="*Docker*"' |
python -c '
import json, sys, re
obj = json.load(sys.stdin)
matched_images = "Images":
for image in obj["Images"]:
if len(re.findall(r"[Dd]ockers?[0-9][.][0-9]2", image["Name"])) > 0:
matched_images["Images"].append(image)
print json.dumps(matched_images)
'
You can pipe the output (which is just a JSON string) to your next bash command if needed with a pipe character following the closing quote. Maybe this can address concerns with using grep since it returns a JSON string instead or regular text.
add a comment |
I wasn't able to find if Jmespath or the --filters flag can support regex, so instead I just piped to Python to run through regex.
aws ec2 describe-images --filters 'Name=name,Values="*Docker*"' |
python -c '
import json, sys, re
obj = json.load(sys.stdin)
matched_images = "Images":
for image in obj["Images"]:
if len(re.findall(r"[Dd]ockers?[0-9][.][0-9]2", image["Name"])) > 0:
matched_images["Images"].append(image)
print json.dumps(matched_images)
'
You can pipe the output (which is just a JSON string) to your next bash command if needed with a pipe character following the closing quote. Maybe this can address concerns with using grep since it returns a JSON string instead or regular text.
add a comment |
I wasn't able to find if Jmespath or the --filters flag can support regex, so instead I just piped to Python to run through regex.
aws ec2 describe-images --filters 'Name=name,Values="*Docker*"' |
python -c '
import json, sys, re
obj = json.load(sys.stdin)
matched_images = "Images":
for image in obj["Images"]:
if len(re.findall(r"[Dd]ockers?[0-9][.][0-9]2", image["Name"])) > 0:
matched_images["Images"].append(image)
print json.dumps(matched_images)
'
You can pipe the output (which is just a JSON string) to your next bash command if needed with a pipe character following the closing quote. Maybe this can address concerns with using grep since it returns a JSON string instead or regular text.
I wasn't able to find if Jmespath or the --filters flag can support regex, so instead I just piped to Python to run through regex.
aws ec2 describe-images --filters 'Name=name,Values="*Docker*"' |
python -c '
import json, sys, re
obj = json.load(sys.stdin)
matched_images = "Images":
for image in obj["Images"]:
if len(re.findall(r"[Dd]ockers?[0-9][.][0-9]2", image["Name"])) > 0:
matched_images["Images"].append(image)
print json.dumps(matched_images)
'
You can pipe the output (which is just a JSON string) to your next bash command if needed with a pipe character following the closing quote. Maybe this can address concerns with using grep since it returns a JSON string instead or regular text.
answered Nov 15 '18 at 20:29
amsgamsg
1
1
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53302912%2fhow-to-use-regular-expression-in-aws-cli-filter%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Would you consider piping the output of the AWS CLI to something like
grep
, and then using that tool's regular expression support?– Adil B
Nov 14 '18 at 15:04
I do not want to do that because I have some more filters and the Filter by name needs to be at the beginning
– uwieuwe4
Nov 14 '18 at 15:15
The AWS CLI uses JMESPath. See: JMESPath Tutorial
– John Rotenstein
Nov 15 '18 at 5:56