So I was following this really nice video Sentiment analysis with tidymodels for Animal Crossing user reviews - YouTube by Julia Silge and a slightly edited version of the video as a blog post Sentiment analysis with tidymodels and #TidyTuesday Animal Crossing reviews | Julia Silge.
It's a great tutorial but had few questions on it.
It seems like
last_fit()evaluates on test data that you trained. How can I apply this to some external data (that's not part of
After training data
fit(review_train)in the code), is it possible to tune the penalty on the test data? If both fitting and tuning is done on the training data, wouldn't that lead to over fitting on the training data?
Bonus Q: the code demonstrates how to make a grid on penalty. How can I tune on both penalty and mixture?