Dictionary Encoding
Starting from Kylin 5, the system supports no dictionary encoding for integer types
With the following settings, optimization of precise deduplication queries can be started:
-
Build a model that contains precise deduplication metrics
-
Modify the configuration of the model and add custom settings to the model in the settings interface:
kylin.query.skip-encode-integer-enabled = true
-
Build the model
Configuration scope
This configuration is only available at the model level
Precautions
- This operation can improve the build performance, if the data hash is serious, it may cause the inflation rate to be too high
- If the value of this parameter changes, you need to re-brush the entire model