How to loop through all HTML files with R
up vote
-1
down vote
favorite
my current code is like this:
library("rvest")
html <- read_html( "Path/myFile")
arq <- dir(path = 'Path', pattern = "name of the file.htm*",full.names
= FALSE)
###### make tables with html files
table <- html %>%
html_nodes('.list') %>%
# .[[8]] %>%
html_table(fill = TRUE)
###### add html files to a big table called big_data
files; function(x)
big_data <- do.call(rbind, teste_em_tabela, quote = TRUE)
The code above works with one file but I would like to make the code work with all html files in my folder.
My doubt is how to loop in all html files inside a selected folder and insert into a table. (which, in this case, is called big_data).
I've tried to make use of for loops and lapply but I had some problems, specially with Error in UseMethod("read_xml").
r
edited Nov 9 at 18:03
G5W
20.6k82041
asked Nov 9 at 18:00
Petrulli
13
add a comment |
up vote
-1
down vote
favorite
my current code is like this:
library("rvest")
html <- read_html( "Path/myFile")
arq <- dir(path = 'Path', pattern = "name of the file.htm*",full.names
= FALSE)
###### make tables with html files
table <- html %>%
html_nodes('.list') %>%
# .[[8]] %>%
html_table(fill = TRUE)
###### add html files to a big table called big_data
files; function(x)
big_data <- do.call(rbind, teste_em_tabela, quote = TRUE)
The code above works with one file but I would like to make the code work with all html files in my folder.
My doubt is how to loop in all html files inside a selected folder and insert into a table. (which, in this case, is called big_data).
I've tried to make use of for loops and lapply but I had some problems, specially with Error in UseMethod("read_xml").
r
edited Nov 9 at 18:03
G5W
20.6k82041
asked Nov 9 at 18:00
Petrulli
13
1
What answers on SO that are super-related to this did you research and find unhelpfu? (this is a solved problem) I mean, you did do that before asking others to spend time on this, right?
– hrbrmstr
Nov 9 at 18:03
Yes, i have tried to search for a simple loop inside files on a folder then i searched a more specific question to know how to use rvest to read html files and finally i searched how to deal with the UseMethod error. I'm newbie and i read other webpages as well, really sorry if it's an obvious question or easy to search at SO. I tried to implement the solutions that i saw but i've got stucked.
– Petrulli
Nov 9 at 18:18
add a comment |
up vote
-1
down vote
favorite
up vote
-1
down vote
favorite
my current code is like this:
library("rvest")
html <- read_html( "Path/myFile")
arq <- dir(path = 'Path', pattern = "name of the file.htm*",full.names
= FALSE)
###### make tables with html files
table <- html %>%
html_nodes('.list') %>%
# .[[8]] %>%
html_table(fill = TRUE)
###### add html files to a big table called big_data
files; function(x)
big_data <- do.call(rbind, teste_em_tabela, quote = TRUE)
The code above works with one file but I would like to make the code work with all html files in my folder.
My doubt is how to loop in all html files inside a selected folder and insert into a table. (which, in this case, is called big_data).
I've tried to make use of for loops and lapply but I had some problems, specially with Error in UseMethod("read_xml").
r
edited Nov 9 at 18:03
G5W
20.6k82041
asked Nov 9 at 18:00
Petrulli
13
my current code is like this:
library("rvest")
html <- read_html( "Path/myFile")
arq <- dir(path = 'Path', pattern = "name of the file.htm*",full.names
= FALSE)
###### make tables with html files
table <- html %>%
html_nodes('.list') %>%
# .[[8]] %>%
html_table(fill = TRUE)
###### add html files to a big table called big_data
files; function(x)
big_data <- do.call(rbind, teste_em_tabela, quote = TRUE)
The code above works with one file but I would like to make the code work with all html files in my folder.
My doubt is how to loop in all html files inside a selected folder and insert into a table. (which, in this case, is called big_data).
I've tried to make use of for loops and lapply but I had some problems, specially with Error in UseMethod("read_xml").
r
r
edited Nov 9 at 18:03
G5W
20.6k82041
asked Nov 9 at 18:00
Petrulli
13
edited Nov 9 at 18:03
G5W
20.6k82041
asked Nov 9 at 18:00
Petrulli
13
edited Nov 9 at 18:03
G5W
20.6k82041
edited Nov 9 at 18:03
G5W
20.6k82041
edited Nov 9 at 18:03
G5W
20.6k82041
20.6k82041
asked Nov 9 at 18:00
Petrulli
13
asked Nov 9 at 18:00
Petrulli
13
asked Nov 9 at 18:00
Petrulli
13
13
1
What answers on SO that are super-related to this did you research and find unhelpfu? (this is a solved problem) I mean, you did do that before asking others to spend time on this, right?
– hrbrmstr
Nov 9 at 18:03
Yes, i have tried to search for a simple loop inside files on a folder then i searched a more specific question to know how to use rvest to read html files and finally i searched how to deal with the UseMethod error. I'm newbie and i read other webpages as well, really sorry if it's an obvious question or easy to search at SO. I tried to implement the solutions that i saw but i've got stucked.
– Petrulli
Nov 9 at 18:18
add a comment |
1
What answers on SO that are super-related to this did you research and find unhelpfu? (this is a solved problem) I mean, you did do that before asking others to spend time on this, right?
– hrbrmstr
Nov 9 at 18:03
Yes, i have tried to search for a simple loop inside files on a folder then i searched a more specific question to know how to use rvest to read html files and finally i searched how to deal with the UseMethod error. I'm newbie and i read other webpages as well, really sorry if it's an obvious question or easy to search at SO. I tried to implement the solutions that i saw but i've got stucked.
– Petrulli
Nov 9 at 18:18
1
1
What answers on SO that are super-related to this did you research and find unhelpfu? (this is a solved problem) I mean, you did do that before asking others to spend time on this, right?
– hrbrmstr
Nov 9 at 18:03
What answers on SO that are super-related to this did you research and find unhelpfu? (this is a solved problem) I mean, you did do that before asking others to spend time on this, right?
– hrbrmstr
Nov 9 at 18:03
Yes, i have tried to search for a simple loop inside files on a folder then i searched a more specific question to know how to use rvest to read html files and finally i searched how to deal with the UseMethod error. I'm newbie and i read other webpages as well, really sorry if it's an obvious question or easy to search at SO. I tried to implement the solutions that i saw but i've got stucked.
– Petrulli
Nov 9 at 18:18
Yes, i have tried to search for a simple loop inside files on a folder then i searched a more specific question to know how to use rvest to read html files and finally i searched how to deal with the UseMethod error. I'm newbie and i read other webpages as well, really sorry if it's an obvious question or easy to search at SO. I tried to implement the solutions that i saw but i've got stucked.
– Petrulli
Nov 9 at 18:18
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53231084%2fhow-to-loop-through-all-html-files-with-r%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
What answers on SO that are super-related to this did you research and find unhelpfu? (this is a solved problem) I mean, you did do that before asking others to spend time on this, right?
– hrbrmstr
Nov 9 at 18:03
Yes, i have tried to search for a simple loop inside files on a folder then i searched a more specific question to know how to use rvest to read html files and finally i searched how to deal with the UseMethod error. I'm newbie and i read other webpages as well, really sorry if it's an obvious question or easy to search at SO. I tried to implement the solutions that i saw but i've got stucked.
– Petrulli
Nov 9 at 18:18