Bake, Craft, Code, Life
Often we will be dealing with text; short or long, and often we only want to find out the important keywords of said text. As with most things, there are several algorithms out there that you could use for this. A common one that you’ve likely even used before is TF-IDF, but there are others…
Read More
Everyone knows South Park. I’ll admit I haven’t watched an episode in at least 5 years, but once I saw this data set I had to dig in. It’s a prime sample to do some quick and dirty linguistic pattern search. It also provide us with a way to understand how to “measure” language. The…
Read More
A lot of times we need to dig through hundreds of lines of text. Maybe we are digging through research journals or we need to go through large amounts of text. A great technique to speed up this process is by using a technique called text summarization. As the name suggests, text summarization summarizes long…
Read More
One of the most tedious things when working with data has to be processing times. Sometimes your data is not big enough and this is never an issue. Other times, your data is so big that you sit… and wait… until a Pandas process or whatever other process you’re trying to run finishes running. 2…
Read More
Instead of a lengthy tutorial, I hope this post serves as a quick reference for those who work with text data on almost a daily basis. Come back to this post for updates as I will be posting them here as I develop them! Strip Accents: On many occasions, I have had to work with…
Read More
Okay, I have a confession to make… I don’t get why people like avocados so much. They’re ‘okay’ at best. I grew up in the Caribbean and avocados were plentiful, in fact, we had an avocado tree in our backyard, twice the size of those i see in stores here, but…I was just never an…
Read More
I’ve been meaning to dig into this data set for a while. There’s just so many text analytics we can learn from it and just learn how we can be better as a society when we read fake news. This data set came from Kaggle.com so if you will follow along go ahead and download…
Read More