Changelog

Copy Markdown View Source

Unicode v1.21.2

This is the changelog for Unicode v1.21.2 released on April 29th, 2026. For older changelogs please consult the release tag on GitHub

Breaking changes

  • Supported on Elixir 1.17 and later only.

Bug Fixes

  • Fix type on Unicode.script/1`` ## Unicode v1.21.1 This is the changelog for Unicode v1.21.1 released on March 16th, 2026. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug Fixes * Compiles without warning on Elixir 1.20.0-rc.3. ## Unicode v1.21.0 This is the changelog for Unicode v1.21.0 released on January 19th, 2025. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Updates to [Unicode 17.0](https://unicode.org/versions/Unicode17.0.0/) data. ## Unicode v1.20.0 This is the changelog for Unicode v1.20.0 released on September 11, 2024. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Updates to [Unicode 16.0](https://unicode.org/versions/Unicode16.0.0/) data. ## Unicode v1.19.0 This is the changelog for Unicode v1.19.0 released on February 29th, 2024. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug Fixes *Unicode.properties/1no longer does anEnum.uniq/1on the result since that breaks the functions contract. * FixUnicode.Emoji.emoji/0. * Fix documentation inUnicode.WordBreak. ### Enhancements * Addindic_conjunc_breakas a property, it is new in Unicode 15.1. * Fix performance regression inUnicode.replace_invalid/2from the original UniRecover library and confirm the code memory usage remains a constant 128 bytes for all benchmark scenarios. Thanks to @Moosieus for the fabulous PR. Closes #10. *Unicode.replace_invalid(string, :utf8, replacement)delegates toString.replace_invalid/2where available (which will be from Elixir 1.16 onwards). * Confirm that the README installation version matches the code version. Thanks to @Moosieus for the PR. ## Unicode v1.18.0 This is the changelog for Unicode v1.18.0 released on October 19th, 2023. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * AddsUnicode.replace_invalid/3to force-validate a binary as a UTF string. Any of the UTF encodings may be validated. Any invalid codepoints or incomplete sequences are replaced with a replacement string. Many thanks to @Moosieus for the contribution. ## Unicode v1.17.0 This is the changelog for Unicode v1.17.0 released on September 17th, 2023. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Updates to [Unicode 15.1](https://unicode.org/versions/Unicode15.1.0/) data. * Improve the security of themix unicode.downloadtask. ## Unicode v1.16.2 This is the changelog for Unicode v1.16.2 released on August 16th, 2023. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Change the parsing of "SpecialCasing.text" specifically to support casing in [unicode_string](https://hex.pm/packages/unicode_string)/. ## Unicode v1.16.1 This is the changelog for Unicode v1.16.1 released on April 22nd, 2023. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Big Fixes * Fix spelling ofUnicode.script_dominance/1. ## Unicode v1.16.0 This is the changelog for Unicode v1.16.0 released on March 18th, 2023. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * AddUnicode.script_statistic/1that returns the first index and grapheme count of the scripts in a string. This is useful to help derive the likely locale of a string. Determining the locale is outside the scope of this library but is required in [ex_cldr_person_names](https://hex.pm/packages/ex_cldr_person_names). * AddUnicode.script_dominance/1to sort the results ofUnicode.script_statistic/1in descending dominance order. ## Unicode v1.15.0 This is the changelog for Unicode v1.15.0 released on September 17th, 2022. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) Note there is no release 1.14. The release is 1.15 to align with Unicode 15 and it is expected to keep this pattern into the future. ### Deprecations * Fix deprecation warnings for Elixir 1.14. Now requires Elixir 1.11 as a minimum release. ### Enhancements * Updates to [Unicode 15](https://www.unicode.org/versions/Unicode15.0.0/). ### Bug Fixes * Fix code fences in docs to be Elixir ## Unicode v1.13.1 This is the changelog for Unicode v1.13.1 released on September 16th, 2021. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug Fixes * When looking up scripts, general categories and properties we indirect through an alias table. But not all entries have alias so in the case alias lookup fails we still need to lookup using the original key. ## Unicode v1.13.0 This is the changelog for Unicode v1.13.0 released on September 15th, 2021. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Change the application name to:unicode(in collaboration with @Qqwy). The old nameex_unicodewill be retired. ## Unicode v1.12.0 This is the changelog for Unicode v1.12.0 released on September 14th, 2021. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Update to use [Unicode 14](https://unicode.org/versions/Unicode14.0.0) release data. ## Unicode v1.12.0-rc.0 This is the changelog for Unicode v1.12.0-rc.0 released on August 27th, 2021. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Updates to Unicode 14 preview data. ## Unicode v1.11.2 This is the changelog for Unicode v1.11.2 released on May 25th, 2021. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug fixes * Makeex_docandbencheeoptional. Thanks to @fireproofsocks. ## Unicode v1.11.1 This is the changelog for Unicode v1.11.1 released on January 5th, 2021. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug fixes * Restrictex_docto only:devand:release. Closes #3. Thanks to @manuelmontenegro. * Fix spec forUnicode.all/0so dialyzer is happy ## Unicode v1.11.0 This is the changelog for Unicode v1.11.0 released on October 8th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug fixes * Rename the derived category:visibleto:graphand change the definition to that in [Unicode Regular Expressions](http://unicode.org/reports/tr18/). Deprecate the derived category:visible. ## Unicode v1.10.0 This is the changelog for Unicode v1.10.0 released on October 5th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug fixes * Revert "Change the definition of the derived propertyAllto be the disjoint set of unicode ranges, not the closed set." sinceAllin the ICU means the full range of codepoints, assigned or otherwise. * Add:inetsand:public_keyto:extra_applicatonsto avoid warnings on Elixir 1.11. ### Enhancements * AddUnicode.assigned/0to return the list of codepoint ranges that are assigned within Unicode * RenameUnicode.ranges/0toUnicode.all/0to better reflect the intent.Unicode.ranges/0is deprecated. ## Unicode v1.9.0 This is the changelog for Unicode v1.9.0 released on October 4th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Change the definition of the derived propertyAllto be the disjoint set of unicode ranges, not the closed set. ## Unicode v1.8.0 This is the changelog for Unicode v1.8.0 released on July 12th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Add the east asian width property toUnicode.Property.fetch/2API * Add the word break property toUnicode.Property.fetch/2API ## Unicode v1.7.0 This is the changelog for Unicode v1.7.0 released on June 22nd, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Add the emoji properties toUniccode.Property.fetch/2API * Add certificate verification to download process ## Unicode v1.6.0 This is the changelog for Unicode v1.6.0 released on May 17th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * AddUnicode.Utils.case_folding/0* AddUnicode.Utils.special_casing/0## Unicode v1.5.0 This is the changelog for Unicode v1.5.0 released on March 14th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements * Add derived categories:printable:and:visible:.:printable:implements the same semnanticsString.printable?/1.:visible:combines the categories[[:L:][:N:][:M:][:P:][:S:][:Zs:]]. ## Unicode v1.4.1 This is the changelog for Unicode v1.4.1 released on March 11th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug Fixes * Regenerate the assigned ranges for Unicode 13 ## Unicode v1.4.0 This is the changelog for Unicode v1.4.0 released on March 11th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Enhancements #### Updates Unicode to version 13.0. As of March 2020, Unicode has introduced [Unicode 13.0](http://blog.unicode.org/2020/03/announcing-unicode-standard-version-130.html) and this data now forms the basis ofex_unicodeversion 1.40. Version 13 of Unicode adds 5,390 characters, for a total of 143,859 characters. These additions include four new scripts, for a total of 154 scripts, as well as 55 new emoji characters. #### Adds derived categories for various quotation marks. Although the unicode character database has a flag to indicate if a given codepoint is a quotation mark, the list does not include CJK quotation marks, dingbats or alternative encodings. Some additional derived categories are therefore added that are taken from [Wikipedia](https://en.wikipedia.org/wiki/Quotation_mark). The added dervived categories are: * QuoteMark - all quote marks * QuoteMarkLeft - all quote marks used on the left * QuoteMarkRight - quote marks used on the right * QuoteMarkAmbidextrous - quote marks used either left or right * QuoteMarkSingle - single quote marks * QuoteMarkDouble - double quote marks These additional derived categories can be used in [Unicode Sets](https://hex.pm/packages/unicode_sets), for example: ```elixir iex> Unicode.Set.match? ?', "[[:quote_mark:]]" true iex> Unicode.Set.match? ?', "[[:quote_mark_left:]]" false iex> Unicode.Set.match? ?', "[[:quote_mark_ambidextrous:]]" true ``` ## Unicode v1.3.1 This is the changelog for Unicode v1.3.1 released on January 8th, 2020. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Bug Fixes * Remove call toCode.ensure_compiled?/1which is deprecated in Elixir 1.10.0. * Fix the ranges for the General Category:assigned. ## Unicode v1.3.0 This is the changelog for Unicode v1.3.0 released on December 3rd, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Breaking Changes * Changed two module names:Unicode.CategorybecomesUnicode.GeneralCategoryandUnicode.CombiningClassbecomesUnicode.CanonicalCombiningClass. These names map directly to the Unicode standard names. It also means all property module names can be derived from the Unicode property name which is what the newUnicode.servers/0function does. ### Enhancements * Add property modules for line break, sentence break, grapheme cluster break and indic syllabic category. These properties are used by the CLDR and Unicode segmentation rules. * AddUnicode.servers/0that maps property names and aliases to a module name that serves that property. ### Bug fixes * FixesUnicode.aliases/0to correctly use the aliases indata/property_alias.txt## Unicode v1.2.0 This is the changelog for Unicode v1.2.0 released on November 27th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Breaking Changes * Script names are now atoms instead of strings to be consistent with other properties ### Enhancements * Addaliases/0,fetch/1andget/1toUnicode.Property* Added additional properties toUnicode.Property. The set now includes those from the UCD filesDerivedCoreProperties.txtandPropList.txt. ## Unicode v1.1.0 This is the changelog for Unicode v1.1.0 released on November 23rd, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Breaking Changes * RemovedUnicode.Guardsfrom this library and moved them to the [unicode_set](https://hex.pm/packages/unicode_guards) package. ### Enhancements *Unicode.Category.categories/0now returns the super categories as well as the subcategories. These super categories are computed at compile time by consolidating the relevant subcategories.Unicode.Category.category/1will only return one category, and it will be the subcategory as it consistent with earlier releases. * AddUnicode.ranges/0that returns all Unicode codepoints as a list of 2-tuples representing the disjoint ranges of valid codepoints. The list is in sorted order. * Addaliases/0forUnicode.Category,Unicode.Script,Unicode.Block, andUnicode.CombiningClasswhich returns the alias map for the relevant module. * Addfetch/1andget/1forUnicode.Category,Unicode.Script,Unicode.Block, andUnicode.CombiningClass. These functions leverage Unicode property value aliases for retrieving codepoints. * AddUnicode.fetch_property/1andUnicode.get_property/1that return the module responsible for handling a given Unicode property. * AddUnicode.compact_ranges/1that given a list of 2-tuple ranges will compact them into as small a list of contiguous blocks as possible * Documented all public functions ## Unicode v1.0.0 This is the changelog for Unicode v1.0.0 released on November 14th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-unicode/unicode/tags) ### Breaking Changes * Rename the module prefix toUnicodesince this package is not linked in any way to theCldrfamily. The hex package is renamed toex_unicode. ## Cldr Unicode v0.7.1 This is the changelog for Unicode v0.7.1 released on November 12th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Bug Fixes * Fixescount/1for blocks, scripts and categories * Replace deprecatedString.normalize/2with:unicode.characters_to_nfd_binary/for OTP release 20 and later. ## Cldr Unicode v0.7.0 This is the changelog for Unicode v0.7.0 released on November 12th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Enhancements * Addis_whitespace/1guard generator ## Cldr Unicode v0.6.0 This is the changelog for Unicode v0.6.0 released on October 22nd, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Enhancements * Update to Emoji 12.1 ## Cldr Unicode v0.5.0 This is the changelog for Unicode v0.5.0 released on May 12th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Enhancements * Update to Unicode 12.1 ## Cldr Unicode v0.4.0 This is the changelog for Unicode v0.4.0 released on April 30th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Enhancements * AddsCldr.Unicode.unaccent/1### Breaking Changes * Block names are now atoms instead of strings ## Cldr Unicode v0.3.0 This is the changelog for Unicode v0.3.0 released on March 28th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Enhancements * Updated to Unicode version 12 ## Cldr Unicode v0.2.0 This is the changelog for Unicode v0.2.0 released on February 24th, 2019. For older changelogs please consult the release tag on [GitHub](https://github.com/elixir-cldr/cldr_unicode/tags) ### Enhancements * Moves the public API to theCldr.Unicode` module. Updates and adds documentation to all public functions. Removes the text annotations from the compiled functions which materially reduces the size of the beam files. ## Cldr Unicode v0.1.0 This is the changelog for Unicode v0.1.0 released on February 23rd, 2019. For older changelogs please consult the release tag on GitHub ### Enhancements * Initial release