Apache Kylin™ Technical Blog

Apache Kylin Meetup @Shanghai Oct 10, 2015

On Oct 10th, 2015, Apache Kylin Meetup was successfully held in German Centre, Shanghai. It was the first Kylin meetup held in Shanghai (the third time worldwide, the first in Silicon Valley, the second in Beijing). Mr. Chad Chun, Director of eBay ADI CCOE made a welcome speech to the meetup. After that, members of Kylin core development team, Kylin’s users in eBay, Apache Tez Committer, Apache Zeppelin Committer and technology partner of MiningLAMP shared rich topics in turn, offering a technology feast of big data to more than 100 attendees.

1. Apache Kylin Tech Deep Dive - Streaming and Plugin Architecture

-Yang Li, Sr. Architect eBay ADI, Apache Kylin Tech Leader, PMC member, introduced the detail design and implementation of Plugin architecture, Streaming Cubing, Fast Cubing, TopN, etc. in Kylin2 which will be released this year. Some new coming features were also mentioned.

2. How Kylin help eCG to analysis Google Analytics Data

-Naiqin Wu, Sr. PM of eBay Classifieds Group, described the difficulties and challenges encountered during the use of Google Analytics by eCG. Then she introduced how to download and organize Google Analytics Data into eBay internal Hadoop Cluster and then build analysis tools for business analysts using Kylin.

3. Apache Tez - Next Gen Execute Engine on Hadoop

-Jeff Zhang, Sr. Engineer of Hortonworks, Apache Tez committer, introduced the detail architecture and design of Apache Tez, comparison between Tez and MapReduce, community development and roadmap etc.

4. Building Data Products with Apache Zeppelin

-Alexander Bezzubov, Sr. Engineer NFLabs (from Korea), Apache Zeppelin committer & PMC member, presented the method of how to leverage Zeppelin to build data product based on github open source. In the end he introduced Zeppelin’s Apache Kylin Intepreter.

5. Kylin Use Case from Finance

-Hua Huang, technology partner of MiningLAMP, Apache Kylin committer, showed the result of the MiningLAMP’s recent research over big data, especially from finance field. He then introduced how MiningLAMP offer big data analysis product to its customers using Kylin. The product has been deployed and launched among its finance customers, supporting report and OLAP analysis capability based on more than 100 Kylin Cubes and dozens of TBs’ data.

6. Apache Kylin Roadmap and open source community

-Luke Han, Lead Product Manager of eBay ADI, Apache Kylin Product Lead, PMC member, introduced the development history of Apache Kylin and the future Roadmap, especially the upcoming release of StreamingOLAP and the correlated properties and release plan. The condition of community development since Kylin became open source was also referred, including newly added Committers (from eBay, Meituan, MiningLAMP), version release etc. Luke made a special mention that Apache Kylin has finished its first round voting, which means it is about to graduate from Apache Incubator and promoted as Apache top-level project soon.

Finally, thanks the staffs from eBay and girls from Fudan University ;-)