Introduction

If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC. In the following, Hive is used as an example, as it is one of Kylin’s data sources and be convenient to configure.

Query Pushdown config

  1. In Kylin’s installation directory, uncomment configuration item kylin.query.pushdown.runner-class-name of config file kylin.properties, and set it to org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl

  2. Add configuration items below in config file kylin.properties. If not set, default value will be used, remember to change host “hiveserver” and port “10000” with your cluster configuraitons.

    • kylin.query.pushdown.jdbc.url: Hive Jdbc’s url, default value is jdbc:hive2://hiveserver:10000/default

    • kylin.query.pushdown.jdbc.driver: Hive Jdbc’s driver class name, default value is org.apache.hive.jdbc.HiveDriver

    • kylin.query.pushdown.jdbc.username: Hive Jdbc’s user name, default value is hive

    • kylin.query.pushdown.jdbc.password: Hive Jdbc’s password, default value is empty string

    • kylin.query.pushdown.jdbc.pool-max-total: Hive Jdbc’s connection pool’s max connected connection number, default value is 8

    • kylin.query.pushdown.jdbc.pool-max-idle: Hive Jdbc’s connection pool’s max waiting connection number, default value is 8

    • kylin.query.pushdown.jdbc.pool-min-idle: Hive Jdbc’s connection pool’s min connected connection number, default value is 0

  3. Restart Kylin

Do Query Pushdown

After Query Pushdown is configured, user is allowed to do flexible queries to the imported tables without avaible cubes.

If query is answered by backup engine, Is Query Push-Down is set to true in the log.


#