Bake, Craft, Code, Life
If you have been in the field for a while, you’ll have realized by now that every single job you’ve had as a “data scientist” consists of different responsibilities and the expectations they have of you are also vastly different. Here I’ve listed some of the things I have learned along the way that have…
Read More
A lot of times I get asked about the applications of Natural Language Processing. If you look at most tutorials online, a lot of NLP is based on books and chat bots, but NLP can be applied to many other areas. A big are where NLP can be applied successfully is consumerism and merchandising. It…
Read More
Often we will be dealing with text; short or long, and often we only want to find out the important keywords of said text. As with most things, there are several algorithms out there that you could use for this. A common one that you’ve likely even used before is TF-IDF, but there are others…
Read More
Everyone knows South Park. I’ll admit I haven’t watched an episode in at least 5 years, but once I saw this data set I had to dig in. It’s a prime sample to do some quick and dirty linguistic pattern search. It also provide us with a way to understand how to “measure” language. The…
Read More
A lot of times we need to dig through hundreds of lines of text. Maybe we are digging through research journals or we need to go through large amounts of text. A great technique to speed up this process is by using a technique called text summarization. As the name suggests, text summarization summarizes long…
Read More
One of the most tedious things when working with data has to be processing times. Sometimes your data is not big enough and this is never an issue. Other times, your data is so big that you sit… and wait… until a Pandas process or whatever other process you’re trying to run finishes running. 2…
Read More
Instead of a lengthy tutorial, I hope this post serves as a quick reference for those who work with text data on almost a daily basis. Come back to this post for updates as I will be posting them here as I develop them! Strip Accents: On many occasions, I have had to work with…
Read More