{"id":10987,"date":"2019-05-06T16:03:38","date_gmt":"2019-05-06T19:03:38","guid":{"rendered":"https:\/\/tarciziosilva.com.br\/blog\/?p=10987"},"modified":"2019-05-11T11:43:55","modified_gmt":"2019-05-11T14:43:55","slug":"text-analysis-with-antconc-for-social-media-data-keyword-lists-and-keyness","status":"publish","type":"post","link":"https:\/\/tarciziosilva.com.br\/blog\/text-analysis-with-antconc-for-social-media-data-keyword-lists-and-keyness\/","title":{"rendered":"Text Analysis with AntConc for social media data: Keyword Lists and Keyness"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-10864\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/04\/antconc-297x300.png\" alt=\"\" width=\"180\" height=\"182\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/04\/antconc-297x300.png 297w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/04\/antconc.png 499w\" sizes=\"auto, (max-width: 180px) 100vw, 180px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">The <\/span><b>Keyword List<\/b><span style=\"font-weight: 400;\"> tool measures which words are unusually frequent or infrequent in datasets or corpora compared to a reference\/benchmark word list (or files).<\/span><\/p>\n<p>This post is part of a series of tutorials about <strong>AntConC<\/strong>:<\/p>\n<ol>\n<li><a href=\"https:\/\/tarciziosilva.com.br\/blog\/text-analysis-with-antconc-for-social-media-data-exploration-intro-files-and-settings\/\" target=\"_blank\" rel=\"noopener\">Intro, Opening a File and Settings<\/a><\/li>\n<li><a href=\"https:\/\/tarciziosilva.com.br\/blog\/text-analysis-with-antconc-for-social-media-data-exploration-word-lists-word-frequencies-and-file-view\/\" target=\"_blank\" rel=\"noopener\">Word Lists and File Viewer\u00a0<\/a><\/li>\n<li><a href=\"https:\/\/tarciziosilva.com.br\/blog\/text-analysis-with-antconc-for-social-media-data-concordancer-and-concordance-plot\/\" target=\"_blank\" rel=\"noopener\">Concordancer and Concordance Plot\u00a0<\/a><\/li>\n<li><a href=\"https:\/\/tarciziosilva.com.br\/blog\/text-analysis-with-antconc-for-social-media-data-clusters-and-n-grams\/\" target=\"_blank\" rel=\"noopener\">Clusters and N-Grams<\/a><\/li>\n<li><a href=\"https:\/\/tarciziosilva.com.br\/blog\/text-analysis-with-antconc-for-social-media-data-collocations\/\" target=\"_blank\" rel=\"noopener\">Collocations\u00a0<\/a><\/li>\n<li><strong>Keyword Lists<\/strong><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p><strong><em>Uploading a Keyword List and analyzing keywords \/ keyness metric<br \/>\n<\/em><\/strong><span style=\"font-weight: 400;\">1. As usual, the first step is to open your files\/corpora and produce a word list. For that example, we are going to use the file with 16k tweets containing the term \u201cBrazil\u2019 (<\/span><a href=\"https:\/\/drive.google.com\/drive\/u\/0\/folders\/1GXHjhuWFDOkLICq7mJ5Tis3cJmu0WXzJ\"><span style=\"font-weight: 400;\">download it<\/span><\/a><span style=\"font-weight: 400;\">): .<\/span><\/p>\n<p><span style=\"font-weight: 400;\">2. Generate the word list through the <\/span><i><span style=\"font-weight: 400;\">Word List<\/span><\/i><span style=\"font-weight: 400;\"> tab.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-10993\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/word-list.png\" alt=\"\" width=\"512\" height=\"389\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/word-list.png 512w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/word-list-150x114.png 150w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/word-list-300x228.png 300w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>3.\u00a0<span style=\"font-weight: 400;\">Basically, the <\/span><i><span style=\"font-weight: 400;\">Keyword List<\/span><\/i><span style=\"font-weight: 400;\"> tool compares your files\/corpora to one or more reference\/benchmark files\/corpora to highlight which words are more unusually frequent or infrequent. Or, in other words, which words are <\/span><b>key<\/b><span style=\"font-weight: 400;\">words in file(s)\/corpora.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">There are three main ways of using the<\/span><i><span style=\"font-weight: 400;\"> Keyword List<\/span><\/i><span style=\"font-weight: 400;\"> tool:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Compare your file(s) to a general corpus representing a national language. Here you can use a reference word list produced from texts representing a national language. <\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Comparing your file(s) to past texts or wordlists. This option could be appropriate for social media data, specially to discover new info. For example, you can compare recent texts to past corpora comprising 12-month period.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Comparing texts produced by different social media communities or texts reacting to different authors\/pages (e.g. Facebook comments in different periods).<\/span><\/li>\n<\/ul>\n<p>4.\u00a0<span style=\"font-weight: 400;\">For the sake of simplicity, we\u2019ll a comparison with the pre-produced corpus called <\/span><i><span style=\"font-weight: 400;\">BNC <\/span><\/i><span style=\"font-weight: 400;\">wordlist. To use it, download the wordlist from our <\/span><a href=\"https:\/\/drive.google.com\/drive\/u\/0\/folders\/1QSvu0ZsRJQJhthuAsRDlH1oFeovtqWR9\"><span style=\"font-weight: 400;\">wordlist folder<\/span><\/a><span style=\"font-weight: 400;\"> (or from the BNC website), click in <\/span><i><span style=\"font-weight: 400;\">Use word list(s)<\/span><\/i><span style=\"font-weight: 400;\"> and click in <\/span><i><span style=\"font-weight: 400;\">Add Files<\/span><\/i><span style=\"font-weight: 400;\"> to add the <\/span><i><span style=\"font-weight: 400;\">BNC_WRITTEN_wordlist.txt<\/span><\/i><span style=\"font-weight: 400;\"> . Click in <\/span><i><span style=\"font-weight: 400;\">Load<\/span><\/i><span style=\"font-weight: 400;\"> then, <\/span><i><span style=\"font-weight: 400;\">Apply<\/span><\/i><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10994 size-large\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/reference-corpus-580x426.png\" alt=\"\" width=\"580\" height=\"426\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/reference-corpus-580x426.png 580w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/reference-corpus-150x110.png 150w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/reference-corpus-300x220.png 300w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/reference-corpus-768x564.png 768w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/reference-corpus.png 987w\" sizes=\"auto, (max-width: 580px) 100vw, 580px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-10995\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written.png\" alt=\"\" width=\"512\" height=\"375\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written.png 512w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written-150x110.png 150w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written-300x220.png 300w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10996 size-full\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written-loaded.png\" alt=\"\" width=\"512\" height=\"377\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written-loaded.png 512w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written-loaded-150x110.png 150w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/BNC-written-loaded-300x221.png 300w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>5.\u00a0<span style=\"font-weight: 400;\">Now you can discover which terms\/words in your dataset are the most \u201cimportant\u201d in the sense they are frequent or infrequent in a unusual amount.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Most unusually frequent words (positive <\/span><i><span style=\"font-weight: 400;\">Keyness<\/span><\/i><span style=\"font-weight: 400;\">):<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10997 size-large\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/positive-keyness-580x438.png\" alt=\"\" width=\"580\" height=\"438\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/positive-keyness-580x438.png 580w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/positive-keyness-150x113.png 150w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/positive-keyness-300x227.png 300w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/positive-keyness-768x580.png 768w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/positive-keyness.png 988w\" sizes=\"auto, (max-width: 580px) 100vw, 580px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Unusually <\/span><b>infrequent words<\/b><span style=\"font-weight: 400;\"> (negative <\/span><i><span style=\"font-weight: 400;\">Keyness<\/span><\/i><span style=\"font-weight: 400;\">). Bear in mind that we\u2019are analyzing Twitter data, so the presence of some terms like <\/span><i><span style=\"font-weight: 400;\">however<\/span><\/i><span style=\"font-weight: 400;\"> or <\/span><i><span style=\"font-weight: 400;\">although<\/span><\/i><span style=\"font-weight: 400;\"> could be related to tweet formats and limitations:<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-10998 size-large\" src=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/negative-keyness-580x437.png\" alt=\"\" width=\"580\" height=\"437\" srcset=\"https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/negative-keyness-580x437.png 580w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/negative-keyness-150x113.png 150w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/negative-keyness-300x226.png 300w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/negative-keyness-768x578.png 768w, https:\/\/tarciziosilva.com.br\/blog\/wp-content\/uploads\/2019\/05\/negative-keyness.png 979w\" sizes=\"auto, (max-width: 580px) 100vw, 580px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>So, this posts concludes our series on AntConc. To learn more about AntConc, text analysis and corpus linguistics:<\/p>\n<ul>\n<li><a href=\"http:\/\/www.laurenceanthony.net\/software\/antconc\/\" target=\"_blank\" rel=\"noopener\">Laurence Anthony&#8217;s website<\/a><\/li>\n<li><a href=\"https:\/\/www.futurelearn.com\/courses\/corpus-linguistics\" target=\"_blank\" rel=\"noopener\">MOOC Corpus Linguistics<\/a><\/li>\n<li>Book &#8220;<a href=\"https:\/\/tarciziosilva.com.br\/blog\/discurso-no-twitter-e-midias-sociais-como-usamos-linguagem-para-criar-afiliacao-na-web\/\" target=\"_blank\" rel=\"noopener\">Discourse of Twitter and Social Media: How We Use Language to Create Affiliation on the Web<\/a>&#8220;<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>The Keyword List tool measures which words are unusually frequent or infrequent in datasets or corpora compared to a reference\/benchmark word list (or files). This post is part of a series of tutorials about AntConC: Intro, Opening a File and Settings Word Lists and File Viewer\u00a0 Concordancer and Concordance Plot\u00a0 Clusters and N-Grams Collocations\u00a0 Keyword [&hellip;]<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,108],"tags":[2581,2593,2592,2586,2591,2579],"class_list":["post-10987","post","type-post","status-publish","format-standard","hentry","category-midias-sociais","category-pesquisa","tag-antconc","tag-keyness","tag-keyword-list","tag-social-media-corpora","tag-social-media-research","tag-text-analysis"],"_links":{"self":[{"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/posts\/10987","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/comments?post=10987"}],"version-history":[{"count":4,"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/posts\/10987\/revisions"}],"predecessor-version":[{"id":10999,"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/posts\/10987\/revisions\/10999"}],"wp:attachment":[{"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/media?parent=10987"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/categories?post=10987"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tarciziosilva.com.br\/blog\/wp-json\/wp\/v2\/tags?post=10987"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}