[nrc.en.mtnt] update word list

release/nrc/nrc.en.mtnt/HISTORY.md

@@ -1,5 +1,13 @@
 # Version History
 
+## 0.3.0 (2024-02-15)
+
+* Major cleanup:
+* Non-words removed (including some acronyms)
+* misspellings corrected (both US and UK/Canadian/Australian spellings preserved)
+* most proper names removed (except names of continents, countries, nationalities, religions)
+* some proper names made lower case (Cardinals to cardinals) though the frequency count unchanged
+
 ## 0.2.0 (2023-02-13)
 
 * Lower-case some common words

release/nrc/nrc.en.mtnt/LICENSE.md

@@ -1,6 +1,6 @@
 The MIT License (MIT)
 
-© 2019-2023 National Research Council Canada
+© 2019-2024 National Research Council Canada
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal

release/nrc/nrc.en.mtnt/README.md

@@ -59,6 +59,18 @@ them to avoid making that [clbuttic mistake][]. That was “fun”. This was
 a pretty manual, and at times, subjective process. Exact replication may
 not be guaranteed.
 
+Additional filtering
+--------------------
+
+From May 2023 through February 2024 additional hand editing was done
+to correct misspellings and remove non-words and many proper names.
+
+Future work
+-----------
+
+* Keep separate files for proper names. Could be several files (personal names,
+geographic names, company/product names, etc.)
+* Include other endings (-s, -ed, -ing, etc.)
 
 [profanities.en]: https://github.com/pmichel31415/mtnt/blob/master/resources/profanities.en
 [clbuttic mistake]: https://thedailywtf.com/articles/The-Clbuttic-Mistake-