Saving the Text of a News Article in R?

Is there some way in R to only save the text from a News Article on the internet??

url_1 <- ''
text_1 <- gettxt(url_1)

url_2 <- ''
text_2 <- gettxt(url_2)

All the text from the article appears, but so does a lot of "extra text" which does not have any meaning. For example:

p. 40/03B\n• ^ a or identifiers\n• Articles with GND identifiers\n• Articles with ICCU identifiers\n•

  • Is there some standard way to only keep the actual text from these articles? Or does this depend too much on the individual structure of the website and no "one size fits all" solution exists for such a problem?
  • Perhaps there might be some method of doing this in R that only recognizes the "actual text"?

Thank you!

Hi @omario,
This looks like an encoding issue. Try:

text_1 <- gettxt(url_1, encoding="UTF-8")
1 Like

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.