Run Kylin with Docker
In order to allow users to easily try Kylin, and to facilitate developers to verify and debug after modifying the source code. We provide Kylin's docker image. In this image, each service that Kylin relies on is properly installed and deployed, including:
- JDK 1.8
- Hadoop 2.8.5
- Hive 1.2.1
- Spark 2.4.7
- Kafka 1.1.1
- MySQL 5.1.73
- Zookeeper 3.4.6
Quickly try Kylin
We have pushed the Kylin image for the user to the docker hub. Users do not need to build the image locally, just execute the following command to pull the image from the docker hub:
docker pull apachekylin/apache-kylin-standalone:4.0.0
After the pull is successful, execute the following command to start the container:
docker run -d \
-m 8G \
-p 7070:7070 \
-p 8088:8088 \
-p 50070:50070 \
-p 8032:8032 \
-p 8042:8042 \
-p 2181:2181 \
apachekylin/apache-kylin-standalone:4.0.0
The following services are automatically started when the container starts:
- NameNode, DataNode
- ResourceManager, NodeManager
- Kylin
and run automatically $KYLIN_HOME/bin/sample.sh
.
After the container is started, we can enter the container through the docker exec -it <container_id> bash
command. Of course, since we have mapped the specified port in the container to the local port, we can open the pages of each service directly in the native browser, such as:
- Kylin Web UI: http://127.0.0.1:7070/kylin/login
- Hdfs NameNode Web UI: http://127.0.0.1:50070
- Yarn ResourceManager Web UI: http://127.0.0.1:8088
Quickly try MDX for Kylin
We have pushed the MDX for Kylin image for the user to the docker hub. Users do not need to build the image locally, just execute the following command to pull the image from the docker hub:
Note: Current docker image contains the
Kylin
andMDX for Kylin
, soMDX for Kylin
will start withKylin
at the same time.
docker pull apachekylin/apache-kylin-standalone:kylin-4.0.1-mondrian
After the pull is successful, execute the following command to start the container:
docker run -d \
-m 8G \
-p 7070:7070 \
-p 7080:7080 \
-p 8088:8088 \
-p 50070:50070 \
-p 8032:8032 \
-p 8042:8042 \
-p 2181:2181 \
apachekylin/apache-kylin-standalone:kylin-4.0.1-mondrian
The extra following service will start based on services of Quickly try Kylin
started:
- MDX for Kylin
After the container is started, we can enter the container through the docker exec -it <container_id> bash
command. Of course, since we have mapped the specified port in the container to the local port, we can open the pages of each service directly in the native browser, such as:
- Kylin Web UI: http://127.0.0.1:7070/kylin/login
- MDX for Kylin Web UI: http://127.0.0.1:7080
- Hdfs NameNode Web UI: http://127.0.0.1:50070
- Yarn ResourceManager Web UI: http://127.0.0.1:8088
Container resource recommendation
In order to allow Kylin to build the cube smoothly, the memory resource we configured for Yarn NodeManager is 6G, plus the memory occupied by each service, please ensure that the memory of the container is not less than 8G, so as to avoid errors due to insufficient memory.
For the resource setting method for the container, please refer to:
- Mac user: docker for mac
- Linux user: docker resource constraints
For how to customize the image, please check the github page kylin/docker.