From the course: Big Data in the Age of AI

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Text analytics

Text analytics

- [Lecturer] I've been teaching in universities for over 20 years, but it took me more than a decade to come to grips with one common element of that job, grading papers. The fact is reading research papers, giving useful feedback, and assigning grades takes a lot of time, and frequently I could get overwhelmed by the effort, the cognitive energy it took. But you know, if you're working in the online world, then you know that that sort of unstructured text information can come in much, much faster than even student papers. Dealing with that fire hose of feedback is a huge challenge for anyone, and that's the entire point of text analytics in big data. Now, there are a few major challenges that prompt all of this. Number one, text is unstructured data. It's, you know, it's there, it's in sentences and paragraphs and words. It's not broken down into, this is a variable, this is a topic. Also, you can have texts from multiple sources. You can have comments and reviews online. You can…

Contents