Bake, Craft, Code, Life
If you have been in the field for a while, you’ll have realized by now that every single job you’ve had as a “data scientist” consists of different responsibilities and the expectations they have of you are also vastly different. Here I’ve listed some of the things I have learned along the way that have…
Read More
Often we will be dealing with text; short or long, and often we only want to find out the important keywords of said text. As with most things, there are several algorithms out there that you could use for this. A common one that you’ve likely even used before is TF-IDF, but there are others…
Read More
Everyone knows South Park. I’ll admit I haven’t watched an episode in at least 5 years, but once I saw this data set I had to dig in. It’s a prime sample to do some quick and dirty linguistic pattern search. It also provide us with a way to understand how to “measure” language. The…
Read More
NOTE: THIS WAS DONE USING PYTHON 2.7. PLEASE, REFER TO UPDATED POST HERE. A lot of times we need to dig through hundreds of lines of text. Maybe we are digging through research journals or we need to go through large amounts of text. A great technique to speed up this process is by using…
Read More
One of the most tedious things when working with data has to be processing times. Sometimes your data is not big enough and this is never an issue. Other times, your data is so big that you sit… and wait… until a Pandas process or whatever other process you’re trying to run finishes running. 2…
Read More
Instead of a lengthy tutorial, I hope this post serves as a quick reference for those who work with text data on almost a daily basis. Come back to this post for updates as I will be posting them here as I develop them! Strip Accents: On many occasions, I have had to work with…
Read More
Okay, I have a confession to make… I don’t get why people like avocados so much. They’re ‘okay’ at best. I grew up in the Caribbean and avocados were plentiful, in fact, we had an avocado tree in our backyard, twice the size of those i see in stores here, but…I was just never an…
Read More
I’ve been meaning to dig into this data set for a while. There’s just so many text analytics we can learn from it and just learn how we can be better as a society when we read fake news. This data set came from Kaggle.com so if you will follow along go ahead and download…
Read More
So, recently, I was asked to changed my password for a service I am subscribed to. And obviously, it couldn’t be something I’ve used before. I tried changing one character, nope it didn’t work. Sigh…listen, I am just very lazy, okay? Changing my password annoys just as much as going grocery shopping. AIN’T NOBODY GOT…
Read More
This is the second part of this text mining series. For part I click here. In this post, we’ll go over unstructured approaches to look at our text data. A good way to learn about what’s inside our text data is to find topics or themes. In this example we will use a Latent Dirichlet…
Read More
Things Grow 