Yasuhiro Horimoto 2018-12-19 12:03:16 +0900 (Wed, 19 Dec 2018) Revision: e7942e7ff5fa5fac327b92d86b31fc1046a76cdc https://github.com/groonga/groonga/commit/e7942e7ff5fa5fac327b92d86b31fc1046a76cdc Message: doc: add missing example Added files: doc/source/example/reference/tokenizers/token-delimit-pattern-option-with-complex-pattern.log Added: doc/source/example/reference/tokenizers/token-delimit-pattern-option-with-complex-pattern.log (+30 -0) 100644 =================================================================== --- /dev/null +++ doc/source/example/reference/tokenizers/token-delimit-pattern-option-with-complex-pattern.log 2018-12-19 12:03:16 +0900 (3f134f450) @@ -0,0 +1,30 @@ +Execution example:: + + tokenize 'TokenDelimit("pattern", "([。！？]+(?![）」])|[\\r\\n]+)\\s*")' "これはペンですか！？リンゴですか？「リンゴです。」" + # [ + # [ + # 0, + # 1545179416.22277, + # 0.0002887248992919922 + # ], + # [ + # { + # "value": "これはペンですか", + # "position": 0, + # "force_prefix": false, + # "force_prefix_search": false + # }, + # { + # "value": "リンゴですか", + # "position": 1, + # "force_prefix": false, + # "force_prefix_search": false + # }, + # { + # "value": "「リンゴです。」", + # "position": 2, + # "force_prefix": false, + # "force_prefix_search": false + # } + # ] + # ] -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://lists.osdn.me/mailman/archives/groonga-commit/attachments/20181219/a3c64e66/attachment.html>
