- 3.1.0 (latest)
- 3.0.1
- 2.35.0
- 2.34.0
- 2.33.0
- 2.32.0
- 2.30.0
- 2.29.3
- 2.28.0
- 2.27.1
- 2.26.0
- 2.25.0
- 2.24.2
- 2.23.0
- 2.22.0
- 2.21.1
- 2.20.2
- 2.19.0
- 2.18.0
- 2.17.0
- 2.16.1
- 2.15.0
- 2.14.0
- 2.13.0
- 2.12.0
- 2.11.0
- 2.10.0
- 2.9.1
- 2.8.0
- 2.7.0
- 2.6.0
- 2.5.0
- 2.4.1
- 2.3.0
- 2.2.0
- 2.1.0
- 2.0.3
- 1.5.1
- 1.4.2
- 1.3.0
- 1.2.1
- 1.1.0
- 1.0.0
- 0.5.2
- 0.4.0
- 0.3.0
- 0.2.0
- 0.1.0
ChunkingConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Serving config for chunking.
Attributes |
|
---|---|
Name | Description |
chunk_size |
int
Optional. The chunk sizes to use when splitting documents, in order of level. |
include_ancestor_headings |
bool
Optional. Whether or not to include ancestor headings when splitting. |
semantic_chunking_group_size |
bool
Optional. The number of tokens to group together when evaluating semantic similarity. |
breakpoint_percentile_threshold |
int
Optional. The percentile of cosine dissimilarity that must be exceeded between a group of tokens and the next. The smaller this number is, the more chunks will be generated. |