CSV Data preprocessing and reformatting python
Multi tool use
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have a csv file with 22000 rows. I need to convert the csv file from the normal rows and columns format to rows with elements separated with commas using python. Elements with same id are to be in a row. New row is to be created for each id.
Sample data before preprocessing is like this
Dataset after processing is like this
I just want to delete the date column and display the elements with same id (in column B) inline.
python pandas csv numpy
add a comment |
I have a csv file with 22000 rows. I need to convert the csv file from the normal rows and columns format to rows with elements separated with commas using python. Elements with same id are to be in a row. New row is to be created for each id.
Sample data before preprocessing is like this
Dataset after processing is like this
I just want to delete the date column and display the elements with same id (in column B) inline.
python pandas csv numpy
3
What have you tried so far? And where did all the apples etc. go? What exactly do you want to do? Do you want to count the occurrences of each item? And where is the timestamp coming from? Please post an example which fully covers your question.
– Scotty1-
Nov 15 '18 at 10:36
Is my solution working for you?
– Mohamed Thasin ah
Nov 16 '18 at 5:19
Sorry guys. I had made a mistake in the positioning of the screenshots. Kindly have a look at the edited question.
– Dheeraj Ravishankar
Nov 16 '18 at 8:28
@DheerajRavishankar - Don't put sample data as image. paste your sample data as text (so that easy to copy and paste to others).
– Mohamed Thasin ah
Nov 19 '18 at 7:16
add a comment |
I have a csv file with 22000 rows. I need to convert the csv file from the normal rows and columns format to rows with elements separated with commas using python. Elements with same id are to be in a row. New row is to be created for each id.
Sample data before preprocessing is like this
Dataset after processing is like this
I just want to delete the date column and display the elements with same id (in column B) inline.
python pandas csv numpy
I have a csv file with 22000 rows. I need to convert the csv file from the normal rows and columns format to rows with elements separated with commas using python. Elements with same id are to be in a row. New row is to be created for each id.
Sample data before preprocessing is like this
Dataset after processing is like this
I just want to delete the date column and display the elements with same id (in column B) inline.
python pandas csv numpy
python pandas csv numpy
edited Nov 16 '18 at 9:01
Dheeraj Ravishankar
asked Nov 15 '18 at 10:18
Dheeraj RavishankarDheeraj Ravishankar
53
53
3
What have you tried so far? And where did all the apples etc. go? What exactly do you want to do? Do you want to count the occurrences of each item? And where is the timestamp coming from? Please post an example which fully covers your question.
– Scotty1-
Nov 15 '18 at 10:36
Is my solution working for you?
– Mohamed Thasin ah
Nov 16 '18 at 5:19
Sorry guys. I had made a mistake in the positioning of the screenshots. Kindly have a look at the edited question.
– Dheeraj Ravishankar
Nov 16 '18 at 8:28
@DheerajRavishankar - Don't put sample data as image. paste your sample data as text (so that easy to copy and paste to others).
– Mohamed Thasin ah
Nov 19 '18 at 7:16
add a comment |
3
What have you tried so far? And where did all the apples etc. go? What exactly do you want to do? Do you want to count the occurrences of each item? And where is the timestamp coming from? Please post an example which fully covers your question.
– Scotty1-
Nov 15 '18 at 10:36
Is my solution working for you?
– Mohamed Thasin ah
Nov 16 '18 at 5:19
Sorry guys. I had made a mistake in the positioning of the screenshots. Kindly have a look at the edited question.
– Dheeraj Ravishankar
Nov 16 '18 at 8:28
@DheerajRavishankar - Don't put sample data as image. paste your sample data as text (so that easy to copy and paste to others).
– Mohamed Thasin ah
Nov 19 '18 at 7:16
3
3
What have you tried so far? And where did all the apples etc. go? What exactly do you want to do? Do you want to count the occurrences of each item? And where is the timestamp coming from? Please post an example which fully covers your question.
– Scotty1-
Nov 15 '18 at 10:36
What have you tried so far? And where did all the apples etc. go? What exactly do you want to do? Do you want to count the occurrences of each item? And where is the timestamp coming from? Please post an example which fully covers your question.
– Scotty1-
Nov 15 '18 at 10:36
Is my solution working for you?
– Mohamed Thasin ah
Nov 16 '18 at 5:19
Is my solution working for you?
– Mohamed Thasin ah
Nov 16 '18 at 5:19
Sorry guys. I had made a mistake in the positioning of the screenshots. Kindly have a look at the edited question.
– Dheeraj Ravishankar
Nov 16 '18 at 8:28
Sorry guys. I had made a mistake in the positioning of the screenshots. Kindly have a look at the edited question.
– Dheeraj Ravishankar
Nov 16 '18 at 8:28
@DheerajRavishankar - Don't put sample data as image. paste your sample data as text (so that easy to copy and paste to others).
– Mohamed Thasin ah
Nov 19 '18 at 7:16
@DheerajRavishankar - Don't put sample data as image. paste your sample data as text (so that easy to copy and paste to others).
– Mohamed Thasin ah
Nov 19 '18 at 7:16
add a comment |
1 Answer
1
active
oldest
votes
I think you need this,
print pd.Series(sum(df.T.values.tolist(),)).value_counts().reset_index()
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53317172%2fcsv-data-preprocessing-and-reformatting-python%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I think you need this,
print pd.Series(sum(df.T.values.tolist(),)).value_counts().reset_index()
add a comment |
I think you need this,
print pd.Series(sum(df.T.values.tolist(),)).value_counts().reset_index()
add a comment |
I think you need this,
print pd.Series(sum(df.T.values.tolist(),)).value_counts().reset_index()
I think you need this,
print pd.Series(sum(df.T.values.tolist(),)).value_counts().reset_index()
answered Nov 15 '18 at 10:53
Mohamed Thasin ahMohamed Thasin ah
4,09932042
4,09932042
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53317172%2fcsv-data-preprocessing-and-reformatting-python%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
h pnOVJlmcwb
3
What have you tried so far? And where did all the apples etc. go? What exactly do you want to do? Do you want to count the occurrences of each item? And where is the timestamp coming from? Please post an example which fully covers your question.
– Scotty1-
Nov 15 '18 at 10:36
Is my solution working for you?
– Mohamed Thasin ah
Nov 16 '18 at 5:19
Sorry guys. I had made a mistake in the positioning of the screenshots. Kindly have a look at the edited question.
– Dheeraj Ravishankar
Nov 16 '18 at 8:28
@DheerajRavishankar - Don't put sample data as image. paste your sample data as text (so that easy to copy and paste to others).
– Mohamed Thasin ah
Nov 19 '18 at 7:16