Error in processing code for saving dataframe into Hbase- spark scala
0
I am trying to run the code from this link:
https://hbase.apache.org/book.html#_save_the_dataframe
But I am getting the error too many arguments, am I missing something ? Because I did not modify the code from the link at all.
If there are any down-voting , please explain or comment ,so that we know the issue on what we are doing wrong.
case class HBaseRecord(col0: String,col1: Boolean,col2: Double,col3: Float,col4: Int, col5: Long,col6: Short,col7: String,col8: Byte)
scala> object HBaseRecord
<console>:27: error: too many arguments for method apply: (i: Int, t: String)HBaseRecord in object HBaseRecord
HBaseRecord(s, i % 2 == 0, i.toDouble, i.toFloat, i, i.toLong, i.toShort, s"String$i: $t", i.toByte)
^
Thanks in advance
scala apache-spark hbase
asked Nov 12 '18 at 21:45
BabuBabu
137113
add a comment |
0
I am trying to run the code from this link:
https://hbase.apache.org/book.html#_save_the_dataframe
But I am getting the error too many arguments, am I missing something ? Because I did not modify the code from the link at all.
If there are any down-voting , please explain or comment ,so that we know the issue on what we are doing wrong.
case class HBaseRecord(col0: String,col1: Boolean,col2: Double,col3: Float,col4: Int, col5: Long,col6: Short,col7: String,col8: Byte)
scala> object HBaseRecord
<console>:27: error: too many arguments for method apply: (i: Int, t: String)HBaseRecord in object HBaseRecord
HBaseRecord(s, i % 2 == 0, i.toDouble, i.toFloat, i, i.toLong, i.toShort, s"String$i: $t", i.toByte)
^
Thanks in advance
scala apache-spark hbase
asked Nov 12 '18 at 21:45
BabuBabu
137113
you can use phoenix for reading/writing RDD/DF from/to Hbase, for more details: phoenix.apache.org/phoenix_spark.html
– Satish Karuturi
Nov 13 '18 at 3:15
Thanks satish, we don't have phoenix environment,I was hoping for a work around and easy way to automate this. Thanks for sharing anyway.
– Babu
Nov 13 '18 at 15:12
I don't think there is a straight solution for saving/reading dataframe to hbase, you need to convert df as rdd then save it as saveAsNewAPIHadoopDataset. Here is the example, have a look. cjcroix.blogspot.com/2015/10/…
– Satish Karuturi
Nov 14 '18 at 6:40
add a comment |
0
0
0
I am trying to run the code from this link:
https://hbase.apache.org/book.html#_save_the_dataframe
But I am getting the error too many arguments, am I missing something ? Because I did not modify the code from the link at all.
If there are any down-voting , please explain or comment ,so that we know the issue on what we are doing wrong.
case class HBaseRecord(col0: String,col1: Boolean,col2: Double,col3: Float,col4: Int, col5: Long,col6: Short,col7: String,col8: Byte)
scala> object HBaseRecord
<console>:27: error: too many arguments for method apply: (i: Int, t: String)HBaseRecord in object HBaseRecord
HBaseRecord(s, i % 2 == 0, i.toDouble, i.toFloat, i, i.toLong, i.toShort, s"String$i: $t", i.toByte)
^
Thanks in advance
scala apache-spark hbase
asked Nov 12 '18 at 21:45
BabuBabu
137113
I am trying to run the code from this link:
https://hbase.apache.org/book.html#_save_the_dataframe
But I am getting the error too many arguments, am I missing something ? Because I did not modify the code from the link at all.
If there are any down-voting , please explain or comment ,so that we know the issue on what we are doing wrong.
case class HBaseRecord(col0: String,col1: Boolean,col2: Double,col3: Float,col4: Int, col5: Long,col6: Short,col7: String,col8: Byte)
scala> object HBaseRecord
<console>:27: error: too many arguments for method apply: (i: Int, t: String)HBaseRecord in object HBaseRecord
HBaseRecord(s, i % 2 == 0, i.toDouble, i.toFloat, i, i.toLong, i.toShort, s"String$i: $t", i.toByte)
^
Thanks in advance
scala apache-spark hbase
scala apache-spark hbase
asked Nov 12 '18 at 21:45
BabuBabu
137113
asked Nov 12 '18 at 21:45
BabuBabu
137113
asked Nov 12 '18 at 21:45
BabuBabu
137113
asked Nov 12 '18 at 21:45
BabuBabu
137113
asked Nov 12 '18 at 21:45
BabuBabu
137113
137113
you can use phoenix for reading/writing RDD/DF from/to Hbase, for more details: phoenix.apache.org/phoenix_spark.html
– Satish Karuturi
Nov 13 '18 at 3:15
Thanks satish, we don't have phoenix environment,I was hoping for a work around and easy way to automate this. Thanks for sharing anyway.
– Babu
Nov 13 '18 at 15:12
I don't think there is a straight solution for saving/reading dataframe to hbase, you need to convert df as rdd then save it as saveAsNewAPIHadoopDataset. Here is the example, have a look. cjcroix.blogspot.com/2015/10/…
– Satish Karuturi
Nov 14 '18 at 6:40
add a comment |
you can use phoenix for reading/writing RDD/DF from/to Hbase, for more details: phoenix.apache.org/phoenix_spark.html
– Satish Karuturi
Nov 13 '18 at 3:15
Thanks satish, we don't have phoenix environment,I was hoping for a work around and easy way to automate this. Thanks for sharing anyway.
– Babu
Nov 13 '18 at 15:12
I don't think there is a straight solution for saving/reading dataframe to hbase, you need to convert df as rdd then save it as saveAsNewAPIHadoopDataset. Here is the example, have a look. cjcroix.blogspot.com/2015/10/…
– Satish Karuturi
Nov 14 '18 at 6:40
you can use phoenix for reading/writing RDD/DF from/to Hbase, for more details: phoenix.apache.org/phoenix_spark.html
– Satish Karuturi
Nov 13 '18 at 3:15
you can use phoenix for reading/writing RDD/DF from/to Hbase, for more details: phoenix.apache.org/phoenix_spark.html
– Satish Karuturi
Nov 13 '18 at 3:15
Thanks satish, we don't have phoenix environment,I was hoping for a work around and easy way to automate this. Thanks for sharing anyway.
– Babu
Nov 13 '18 at 15:12
Thanks satish, we don't have phoenix environment,I was hoping for a work around and easy way to automate this. Thanks for sharing anyway.
– Babu
Nov 13 '18 at 15:12
I don't think there is a straight solution for saving/reading dataframe to hbase, you need to convert df as rdd then save it as saveAsNewAPIHadoopDataset. Here is the example, have a look. cjcroix.blogspot.com/2015/10/…
– Satish Karuturi
Nov 14 '18 at 6:40
I don't think there is a straight solution for saving/reading dataframe to hbase, you need to convert df as rdd then save it as saveAsNewAPIHadoopDataset. Here is the example, have a look. cjcroix.blogspot.com/2015/10/…
– Satish Karuturi
Nov 14 '18 at 6:40
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53270558%2ferror-in-processing-code-for-saving-dataframe-into-hbase-spark-scala%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53270558%2ferror-in-processing-code-for-saving-dataframe-into-hbase-spark-scala%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
you can use phoenix for reading/writing RDD/DF from/to Hbase, for more details: phoenix.apache.org/phoenix_spark.html
– Satish Karuturi
Nov 13 '18 at 3:15
Thanks satish, we don't have phoenix environment,I was hoping for a work around and easy way to automate this. Thanks for sharing anyway.
– Babu
Nov 13 '18 at 15:12
I don't think there is a straight solution for saving/reading dataframe to hbase, you need to convert df as rdd then save it as saveAsNewAPIHadoopDataset. Here is the example, have a look. cjcroix.blogspot.com/2015/10/…
– Satish Karuturi
Nov 14 '18 at 6:40