2014年9月21日 星期日

Content Analysis in Social Media

Hi, everyone. I'm Yang Guanze. I have learned a lot about social media in the course of IEMS5723, and very happy to share some thoughts about content analysis with you here.

Social media is becoming increasingly important in people daily life as the development of the internet and mobile technology. It’s normal to see people share their feelings and interesting experience in micro-blog or their circle of friends. And content analysis is a crucial way for the social media to know how people think and perform in certain condition, and by using that can help social media improve their users experience.

But the contents which generated by users are really are too many. According to the investigation, 0.3 billion users of sina weibo generate 100TB’s text content, which not including comments and pictures. And the variety of the data of sina weibo is very complex too(Figure 1.). So how to collect and analyze them?

Figure 1. Variety of Social Network data












●natural language
●profile/tags
●comments and repost
●relationships of users




Big data are high-volume, high-velocity, and /or high-variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization. As mentioned above, the data in social media are kind of big data which users disclosure them voluntarily.

I think the essential way to process the data is to analyze the text content. The processing of large data can be seen as a natural extension of data mining, called the text mining. [1]And after that we can do the natural language processing(NLP). 

Besides the concept which mentioned by our teacher on class, I think natural language can be divided into two parts: objective language and subjective language. The former is a statement of fact, and the latter expressed emotion. We can get people’s thoughts by the extraction of subjective language, which will help to improve social media’s performance.

Reference:
[1] Wei Li, Tian Tang, Lei Li. Mining. Mining Public Opinions from Chinese Social Media. 

12 則留言:

  1. cool,but what is the definition of objective and subjective language?

    回覆刪除
  2. The passage really inspires me a lot,especially your brilliant idea of big data and the analysis of text content.I totally agree with you on the significance of big data which will certainly contribute to the development of new technologies.

    回覆刪除
  3. We use social media in our daily life and can't live without it. Very good that you mention about big data. And Rosanna taught us K-means clustering which is a very good algorithm to deal with data. I'll go to library to borrow some books about big data. Hahahahahaha......

    回覆刪除
  4. I benefit a lot from your beautiful post. Just as you mentioned,along with the advance of the society, we are now living in a world of numerous messages. Everyone uses social platform to get and share information related with him. More and more netizen have been used to social software, such as Facebook, Google+, Wechat and Qzone. We can acquire great data from these social circles, which will make a amazing contribution to improving customs‘ experience.
    From your opinion, I can learn the deep cognition you get of this course. And I am in high favor of your idea of dealing with the text content. I think we can have a further communication when free. I also have some similar thoughts to share with you.

    回覆刪除
  5. I found that you have listened to our teacher clearly, and you have a very good view in content analysis, which make me learned a lot.

    回覆刪除
  6. You analyzed the data of social media. As you mentioned above,the data is complex,so can you explain for me how the media deal with the data?

    回覆刪除
  7. You emphasize the importance of social media. Indeed, we can learn more about how people behave online and offline by content analysis. Finally, you mention objective language athink maybe they are crucial for analyzing social media.

    回覆刪除
  8. Hi mate, you mentioned that data from social media is which people give willingly, indeed it is, and I suppose that makes the data is more valuable than data from other sources, and more worthy to be studied.

    回覆刪除
  9. Wow, subjective and objective language, what an interesting topic. As far as I'm concerned, I believe subjective language is more important to analyze. Just because subjective language can fully present the people' mood and feeling, by analyzing that can help us know users better. To meet their needs, improve services and so on. Do you agree with me?^_^

    回覆刪除
  10. We have discussed on lots of things about subjective language. We gave some comments positive or negative scores. However, we ignored the objective ones when we analysis. Now you make me think about their value, thank you for your sharing!

    回覆刪除
  11. your blog is pretty cool,but what is the definition of objective and subjective language? maybe you could give an example to help us understand. Anyway, thanks for your share.

    回覆刪除
  12. you blog have tell how to use content analysis to identify what exists, act as reality checks, be used to study societal change , test a hypothesis and learn document trends.And the content analysis is a powerful tool that can be used for many reasons, as it looks at user content on the web to establish and assist in understanding trends.

    回覆刪除