Sequitur algorithm: Difference between revisions

Revision as of 01:55, 14 January 2009

Latest revision as of 00:53, 6 December 2024

(37 intermediate revisions by 31 users not shown)

Line 1:

'''Sequitur''' (or '''Nevill-ManningManning–Witten algorithm''') is a recursive algorithm developed by [[Craig Nevill-Manning]] and [[Ian H. Witten]] in 1997<ref name=Nevill-manning1997>{{cite journal

{{redirect6|Sequitur|the Latin phrase|Non sequitur|the cutting implement|Secateur}}

| author = Nevill-Manning, C.G.

| author-link = Craig Nevill-Manning

'''Sequitur''' (or ''Nevill-Manning algorithm'') is a recursive algorithm developed by [[Craig Nevill-Manning]] and [[Ian H. Witten]] in 1997<ref name=Nevill-manning1997>{{cite journal

| coauthorsauthor2 = Witten, I.H.

| year = 1997

| title = Identifying Hierarchical Structure in Sequences: A linear-time algorithm

| journalarxiv = Arxiv preprint= cs.AI/9709102

| bibcode= 1997cs........9102N

}}</ref> that infers a hierarchical structure ([[Context-free_grammar|context-free grammar]]) from a sequence of discrete symbols. The algorithm operates in linear space and time. It can be used in [[data compression]] software applications.<ref name=Nevill-manning1997_2>{{cite book

| doi = 10.1109/DCC.1997.581951

| author = Nevill-Manning, C.G.

| author-link = Craig Nevill-Manning

| coauthors = Witten, I.H.

| title = Proceedings DCC '97. Data Compression Conference

| year = 1997

| pages = 3–11

| title = Identifying Hierarchical Structure in Sequences: A linear-time algorithm

| author2=Witten, I.H.

| journal = Arxiv preprint cs.AI/9709102

| year = 1997

| url = http://arxiv.org/abs/cs/9709102

| chapter = Linear-Time, Incremental Hierarchy Inference for Compression

| accessdate = 2008-04-10

| isbn = 978-0-8186-7761-8

}}</ref> that infers a hierarchical structure ([[Context-free_grammar|context-free grammar]]) from a sequence of discrete symbols. The algorithm operates in linear space and time. It can be used in [[data compression]] software applications.

| citeseerx = 10.1.1.30.2305

| s2cid = 14324301

}}</ref>

== Constraints ==

The sequitur algorithm constructs a grammar by substituting repeating phrases in the given sequence with new rules and therefore produces a concise representation of the sequence. For example, if the sequence is

: S→abcab,

the algorithm will produce

: S→AcA, A→ab.

While scanning the input sequence, the algorithm follows two constraints for generating its grammar efficiently: '''digram uniqueness''' and '''rule utility'''.

=== Digram uniqueness ===

Whenever a new symbol is scanned from the sequence, it is appended with the last scanned symbol to form a new [[Bigram|digram]]. If this digram has been formed earlier then a new rule is made to replace both occurrences of the digrams.

Therefore, it ensures that no digram occurs more than once in the grammar. For example, in the sequence '''S→abaaba''', when the first four symbols are already scanned, digrams formed are '''ab, ba, aa'''. When the fifth symbol is read, a new digram 'ab' is formed which exists already. Therefore, both instances of 'ab' are replaced by a new rule (say, A) in ''S''. Now, the grammar becomes '''S→AaAa, A→ab''', and the process continues until no repeated digram exists in the grammar.

=== Rule utility ===

This constraint ensures that all the rules are used more than once in the right sides of all the productions of the grammar, i.e., if a rule occurs just once, it should be removed from the grammar and its occurrence should be substituted with the symbols from which it is created. For example, in the above example, if one scans the last symbol and applies digram uniqueness for 'Aa', then the grammar will produce: '''S→BB, A→ab, B→Aa'''. Now, rule 'A' occurs only once in the grammar in '''B→Aa'''. Therefore, A is deleted and finally the grammar becomes

: '''S→BB, B→aba'''.

This constraint helps reduce the number of rules in the grammar.

== Method summary ==

The algorithm works by scanning a sequence of [[terminal symbol]]s, and building a list of all the symbol pairs which it has read. Whenever a second occurrence of a pair is discovered, the two occurrences are replaced in the sequence by an invented [[nonterminal symbol]], the list of symbol pairs is adjusted to match the new sequence, and scanning continues. If a pair's nonterminal symbol is used only in the just created symbol's definition, the used symbol is replaced by its definition and the symbol is removed from the defined nonterminal symbols. Once the scanning has been completed, the transformed sequence can be interpreted as the top-level rule in a grammar for the original sequence. The rule definitions for the nonterminal symbols which it contains can be found in the list of symbol pairs. Those rule definitions may themselves contain additional nonterminal symbols whose rule definitions can also be read from elsewhere in the list of symbol pairs.<ref>[https://github.com/GrammarViz2/grammarviz2_src GrammarViz 2.0 – Sequitur and parallel Sequitur implementations in Java, Sequitur-based time series patterns discovery]</ref>

==See also==

* [[Context-free_grammar|context-free grammar]]

* [[Data compression]]

* [[Context-free_grammar_generation_algorithms|Algorithms for context-free grammar generation]]

* [[Lossless_compressionLossless compression|losslessLossless data compression]]

* [[dataStraight-line compressiongrammar]]

* [[Byte pair encoding]]

==References==

{{reflistReflist}}

==External links==

* [http://www.sequitur.info/ sequitur.info – the reference Sequitur algorithm implementation in C++, Java, and other languages]

{{Compression methods}}

[[Category:Lossless compression algorithms]]

[[Category:Lossless compression algorithms]]

{{comp-sci-stub}}

[[Category:Data compression]]

[[de:Sequitur]]

[[pl:Sequitur]]

[[fi:Sequitur-algoritmi]]