/explore
|
You are here 
|
spacy.io | ||
| | | | |
justinhj.github.io
|
|
| | | | | [AI summary] The user has provided a detailed explanation of implementing the BPE (Byte Pair Encoding) algorithm for tokenization, focusing on the challenges and considerations involved in the process. They describe the use of different conflict resolution strategies, such as first occurrence and lexicographical ordering, and discuss the optimization techniques applied to improve performance, including incremental frequency counting and efficient data structures. The user also outlines future directions for the project, such as porting to Zig, exploring other tokenization algorithms, and optimizing encoding/decoding steps. The response highlights the complexity of working with C++ and the benefits of using modern C++ practices while emphasizing the importanc... | |
| | | | |
explosion.ai
|
|
| | | | | Coreference resolution is the problem of resolving entities in texts to references such as pronouns. Even if you've never heard of it, it's something we all do constantly every day, and is a key to understanding natural language. We recently added an experimental implementation of an end-to-end neural coreference component to spaCy. This post explains the architecture of our model in detail. | |
| | | | |
towardsml.wordpress.com
|
|
| | | | | Unless you have been out of touch with the Deep Learning world, chances are that you have heard about BERT - it has been the talk of the town for the last one year. At the end of 2018 researchers at Google AI Language open-sourced a new technique for Natural Language Processing (NLP) called BERT... | |
| | | | |
michael-lewis.com
|
|
| | | This is a short summary of some of the terminology used in machine learning, with an emphasis on neural networks. I've put it together primarily to help my own understanding, phrasing it largely in non-mathematical terms. As such it may be of use to others who come from more of a programming than a mathematical background. | ||
