Apache Zeppelin Release 0.7.0
The Apache Zeppelin community is pleased to announce the availability of the 0.7.0 release.
The community put significant effort into improving Apache Zeppelin since the last release, focusing on multiuser support, pluggable visualization, better interpreter support. More than 100+ contributors provided 700+ patches for new features, improvements and bug fixes. More than 480+ issues have been resolved.
We encourage to download the latest release. Feedback through the mailing lists is very welcome.
Multiuser Support
- ZEPPELIN-987 - Secure interpreter setting, credentials and configurations page
- ZEPPELIN-1144 - Zeppelin home page should only list notebooks with read or write permission
- ZEPPELIN-1210 - Run interpreter per user
- ZEPPELIN-1320 - Run zeppelin interpreter process as web front end user - Interpreter user impersonation
- ZEPPELIN-1472 - Create new LdapRealm based on Apache Knox LdapRealm: Provides LdapRealm Functionality similar to Apache Knox
- ZEPPELIN-1586 - Add security check in Notebook Rest api
- ZEPPELIN-1594 - Support personalized mode
- Zeppelin-1611 - Support PAM (System User) Authentication
- ZEPPELIN-1707 - Pass userName when creating interpreter through thrift
- ZEPPELIN-1730 - impersonate spark interpreter using --proxy-user
- ZEPPELIN-1770 - Restart only the client user's interpreter when restarting interpreter setting
Visualization
- ZEPPELIN-212 - Multiple paragraph results
- ZEPPELIN-732 - Helium Application
- ZEPPELIN-1371 - Add text/numeric conversion support to table display
Backend interpreter support
This release includes new interpreter support for
Spark
- ZEPPELIN-1643 - Make spark web UI accessible from interpreters page
- ZEPPELIN-1815 - Support Spark 2.1
- ZEPPELIN-1883 - Can't import spark submitted packages in PySpark
Python
- ZEPPELIN-1115 - interpreter for SQL over DataFrame
- ZEPPELIN-1318 - Add support for matplotlib displaying png images in python interpreter
- ZEPPELIN-1345 - Create a custom matplotlib backend that natively supports inline plotting in a python interpreter cell
- ZEPPELIN-1655 - Dynamic forms in Python interpreter do not work
- ZEPPELIN-1671 - Conda interpreter
- ZEPPELIN-1683 - Run python process in docker container
Markdown
- ZEPPELIN-777 - Math formula support
- ZEPPELIN-1387 - Support table syntax in markdown interpreter
- ZEPPELIN-1614 - Remove markdown4j dep and use pegdown by default
Livy
- ZEPPELIN-1258 - Add Spark packages support to Livy interpreter
- ZEPPELIN-1293 - Automatically attach or create to a new session
- ZEPPELIN-1432 - Support cancellation of paragraph execution
- ZEPPELIN-1609 - using pyspark(python3) with livy interperter
- ZEPPELIN-2006 - Livy interpreter doesn't work in anonymous mode
Flink
- ZEPPELIN-1632 - Add the possibility to cancel flink jobs in local mode
Elasticsearch
- ZEPPELIN-1537 - Elasticsearch improvement for results of aggregations
- ZEPPELIN-1821 - Add HTTP client to elasticsearch interpreter
Notebook
- ZEPPELIN-1152 - Listing note revision history
- ZEPPELIN-1825 - Use versioned notebook storage by default
Job Management
- ZEPPELIN-531 - Job management
UI/UX Improvement
- ZEPPELIN-707 - Automatically adds %.* of previous paragraph's typing
- ZEPPELIN-1061 - Select default interpreter while creating note
- ZEPPELIN-1564 - Enable note deletion and paragraph output clear from main page
- ZEPPELIN-1566 - Make paragraph editable with double click
- ZEPPELIN-1628 - Enable renaming note from the main page
- ZEPPELIN-1629 - Enable renaming folder from the main page
- ZEPPELIN-1736 - Introduce trash & enable removing folder
Noteworthy Changes
- Zeppelin doesn't use
ZEPPELIN_JAVA_OPTS
as default value ofZEPPELIN_INTP_JAVA_OPTS
and also the same forZEPPELIN_MEM
/ZEPPELIN_INTP_MEM
. If user want to configure the jvm opts of interpreter process, please setZEPPELIN_INTP_JAVA_OPTS
andZEPPELIN_INTP_MEM
explicitly. If you don't setZEPPELIN_INTP_MEM
, Zeppelin will set it to-Xms1024m -Xmx1024m -XX:MaxPermSize=512m
by default. - Mapping from
%jdbc(prefix)
to%prefix
is no longer available. Instead, you can use%[interpreter alias]
with multiple interpreter setttings on GUI. - Usage of
ZEPPELIN_PORT
is not supported in ssl mode. Instead useZEPPELIN_SSL_PORT
to configure the ssl port. Value fromZEPPELIN_PORT
is used only whenZEPPELIN_SSL
is set tofalse
. - The support on Spark 1.1.x to 1.3.x is deprecated.
- Zeppelin uses
pegdown
as themarkdown.parser.type
option for the%md
interpreter. Rendered markdown might be different from what you expected - note.json format has been changed to support multiple types of output in a paragraph. Zeppelin will automatically convert old format to new format. 0.6 or lower version can read new note.json format but output will not be displayed. For the detail, see ZEPPELIN-212 and pull request.
- Note storage layer will utilize
GitNotebookRepo
by default instead ofVFSNotebookRepo
storage layer, which is an extension of latter one with versioning capabilities on top of it. - Markdown and angular paragraphs will hide editor automatically after run and user can open editor by double clicking those paragraphs.
- Select box dynamic form doesn't run on change but on enter after change.
Known issues
- ZEPPELIN-2048: Can't run first paragraph when personalize mode on
You can visit issue tracker for full list of issues being resolved.
Contributors
This release would not be possible without the following community members' contributions:
Jeff Zhang, Mina Lee, AhyoungRyu, astroshim, Lee moon soo, Prabhjyot Singh, Khalid Huseynov, 1ambda, Jongyoul Lee, CloverHearts, Damien CORNEAU, Anthony Corbacho, Luciano Resende, Alexander Bezzubov, Renjith Kamath, Alex Goodman, cloverhearts, soralee, Kavin, Sangwoo Lee, WeichenXu, rajarajan-g, felizbear, Igor Drozdov, Myoungdo Park, rawkintrevo, Kai Jiang, Jun Kim, karuppayya, Rafal Wojdyla, Prasad Wagle, agura, Kousuke Saruta, fvaleri, Minwoo Kang, mahmoudelgamal, Naveen Subramanian, Paul Bustios, Peilin Yang, Rerngvit Yanggratoke, Mohammad Amin Khashkhashi Moghaddam, Hao Xia, Bruno Bonnin, Philipp, sergey_sokur, hyonzin, suvam97, Felix Cheung, vensant, Rohit Choudhary, DuyHai DOAN, Beria, Randy Gelhausen, Sangmin Yoon, meenakshisekar, purechoc, zhongjian, Alexander Shoshin, Benoy Antony, Chin Tzulin, Chris Snow, Daniel Jeon, FireArrow, Jan Hentschel, Jesang Yoon, John Trengrove, Joju Rajan, Karup, Kavin Kumar, Kevin Kim, LantaoJin, Liu Xiang, Matthew Penny, Mleekko, Ondřej Krško, Python_Max, Roger Filmyer, Sagar Kulkarni, Shiv Shankar Subudhi, Steven Han, SungjuKwon, Trevor Grant, Vipin Rathor, Vitaly Polonetsky, Yiming Liu, Yunho Maeng, Zak Hassan, ZhangEthan, amir sanjar, baekhoseok, chie8842, doanduyhai, fred777, gdupont, gss2002, hkropp, hyukjinkwon, laesunk, kenshalo, lichenglin, oganizang, passionke, paulbustios, robbins, sadikovi, terrylee, victor.sheng
The following people helped verifying this release:
CloverHearts, Jun Kim, Prabhjyot Singh, Jeff Zhang, Hyung Sung Shim, Ahyoung Ryu, Md. Rezaul Karim, Alexander Bezzubov, Alexander Goodman, Lei Wang, Felix Cheung, DuyHai Doan, Vinay Shukla, Khalid Huseynov, Jongyoul Lee, Sora Lee, Windy Qin, rohit choudhary, moon soo Lee, Andreas Weise, Renjith Kamath, Mina Lee