Google BigQuery Scheduling Query error on Manual Run
I can successfully run Bigquery Scheduled Queries with @Run_time, @run_date parameters.
You can review Google's inadequate documentation on https://cloud.google.com/bigquery/docs/scheduling-queries
But when I try, manual run fails; "Error in starting transfer runs: Request contains an invalid argument. Dismiss" not any detail :(
Example code: (please be attentions i use @run_date)
Destination table: test_"%Y%m%d"
The parameter named table serves to create a different table for each day.
For example
test_20181112
test_20181113 etc.
SELECT
@run_date AS mydate,
title,
author,
text
FROM `bigquery-public-data.hacker_news.stories`
LIMIT
10
I think the problem is caused by the @run_date parameter in the query during manual operation.
My project is a little more complicated, I've added this code so everyone can try it easily.
As I mentioned above, this scheduled task works correctly in the initial setup. But when I try to run manual, it gives an error.
Can you show me the way?
Thanks for your helps.
google-bigquery scheduled-tasks
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
add a comment |
I can successfully run Bigquery Scheduled Queries with @Run_time, @run_date parameters.
You can review Google's inadequate documentation on https://cloud.google.com/bigquery/docs/scheduling-queries
But when I try, manual run fails; "Error in starting transfer runs: Request contains an invalid argument. Dismiss" not any detail :(
Example code: (please be attentions i use @run_date)
Destination table: test_"%Y%m%d"
The parameter named table serves to create a different table for each day.
For example
test_20181112
test_20181113 etc.
SELECT
@run_date AS mydate,
title,
author,
text
FROM `bigquery-public-data.hacker_news.stories`
LIMIT
10
I think the problem is caused by the @run_date parameter in the query during manual operation.
My project is a little more complicated, I've added this code so everyone can try it easily.
As I mentioned above, this scheduled task works correctly in the initial setup. But when I try to run manual, it gives an error.
Can you show me the way?
Thanks for your helps.
google-bigquery scheduled-tasks
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
add a comment |
I can successfully run Bigquery Scheduled Queries with @Run_time, @run_date parameters.
You can review Google's inadequate documentation on https://cloud.google.com/bigquery/docs/scheduling-queries
But when I try, manual run fails; "Error in starting transfer runs: Request contains an invalid argument. Dismiss" not any detail :(
Example code: (please be attentions i use @run_date)
Destination table: test_"%Y%m%d"
The parameter named table serves to create a different table for each day.
For example
test_20181112
test_20181113 etc.
SELECT
@run_date AS mydate,
title,
author,
text
FROM `bigquery-public-data.hacker_news.stories`
LIMIT
10
I think the problem is caused by the @run_date parameter in the query during manual operation.
My project is a little more complicated, I've added this code so everyone can try it easily.
As I mentioned above, this scheduled task works correctly in the initial setup. But when I try to run manual, it gives an error.
Can you show me the way?
Thanks for your helps.
google-bigquery scheduled-tasks
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
I can successfully run Bigquery Scheduled Queries with @Run_time, @run_date parameters.
You can review Google's inadequate documentation on https://cloud.google.com/bigquery/docs/scheduling-queries
But when I try, manual run fails; "Error in starting transfer runs: Request contains an invalid argument. Dismiss" not any detail :(
Example code: (please be attentions i use @run_date)
Destination table: test_"%Y%m%d"
The parameter named table serves to create a different table for each day.
For example
test_20181112
test_20181113 etc.
SELECT
@run_date AS mydate,
title,
author,
text
FROM `bigquery-public-data.hacker_news.stories`
LIMIT
10
I think the problem is caused by the @run_date parameter in the query during manual operation.
My project is a little more complicated, I've added this code so everyone can try it easily.
As I mentioned above, this scheduled task works correctly in the initial setup. But when I try to run manual, it gives an error.
Can you show me the way?
Thanks for your helps.
google-bigquery scheduled-tasks
google-bigquery scheduled-tasks
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
asked Nov 13 '18 at 11:00
Emrah ÖzkanEmrah Özkan
11
11
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
I think that there is a bug in manunal run.
You should choose carefully the start date and the end date ( the same as a previous run ) in order to not get this error
answered Dec 24 '18 at 10:59
MarlMarl
520410
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
add a comment |
Thank you for your answer.
I found the cause of the problem;
If you select the end date today, it gives an error.
But if you choose the previous days, it doesn't give any error ..
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
I tried manual run to backfill October 2018 data, but got errorError in starting transfer runs: Request contains an invalid argument.
– Khusna Nadia
Feb 1 at 5:02
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53279546%2fgoogle-bigquery-scheduling-query-error-on-manual-run%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
I think that there is a bug in manunal run.
You should choose carefully the start date and the end date ( the same as a previous run ) in order to not get this error
answered Dec 24 '18 at 10:59
MarlMarl
520410
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
add a comment |
I think that there is a bug in manunal run.
You should choose carefully the start date and the end date ( the same as a previous run ) in order to not get this error
answered Dec 24 '18 at 10:59
MarlMarl
520410
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
add a comment |
I think that there is a bug in manunal run.
You should choose carefully the start date and the end date ( the same as a previous run ) in order to not get this error
answered Dec 24 '18 at 10:59
MarlMarl
520410
I think that there is a bug in manunal run.
You should choose carefully the start date and the end date ( the same as a previous run ) in order to not get this error
answered Dec 24 '18 at 10:59
MarlMarl
520410
answered Dec 24 '18 at 10:59
MarlMarl
520410
answered Dec 24 '18 at 10:59
MarlMarl
520410
answered Dec 24 '18 at 10:59
MarlMarl
520410
520410
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
add a comment |
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
Can you explain of "the same as a previous run"? I don't get what you mean.
– Khusna Nadia
Feb 1 at 5:05
add a comment |
Thank you for your answer.
I found the cause of the problem;
If you select the end date today, it gives an error.
But if you choose the previous days, it doesn't give any error ..
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
I tried manual run to backfill October 2018 data, but got errorError in starting transfer runs: Request contains an invalid argument.
– Khusna Nadia
Feb 1 at 5:02
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
add a comment |
Thank you for your answer.
I found the cause of the problem;
If you select the end date today, it gives an error.
But if you choose the previous days, it doesn't give any error ..
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
I tried manual run to backfill October 2018 data, but got errorError in starting transfer runs: Request contains an invalid argument.
– Khusna Nadia
Feb 1 at 5:02
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
add a comment |
Thank you for your answer.
I found the cause of the problem;
If you select the end date today, it gives an error.
But if you choose the previous days, it doesn't give any error ..
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
Thank you for your answer.
I found the cause of the problem;
If you select the end date today, it gives an error.
But if you choose the previous days, it doesn't give any error ..
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
answered Dec 25 '18 at 11:05
Emrah ÖzkanEmrah Özkan
11
11
I tried manual run to backfill October 2018 data, but got errorError in starting transfer runs: Request contains an invalid argument.
– Khusna Nadia
Feb 1 at 5:02
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
add a comment |
I tried manual run to backfill October 2018 data, but got errorError in starting transfer runs: Request contains an invalid argument.
– Khusna Nadia
Feb 1 at 5:02
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
I tried manual run to backfill October 2018 data, but got error
Error in starting transfer runs: Request contains an invalid argument.– Khusna Nadia
Feb 1 at 5:02
I tried manual run to backfill October 2018 data, but got error
Error in starting transfer runs: Request contains an invalid argument.– Khusna Nadia
Feb 1 at 5:02
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
Just to give you update. In my case, I got that error for manual run the scheduled query that contains udf javascript function.
– Khusna Nadia
Feb 1 at 7:06
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53279546%2fgoogle-bigquery-scheduling-query-error-on-manual-run%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
