Basic Display System in Apache Zeppelin
Text
By default, Apache Zeppelin prints interpreter response as a plain text using text
display system.
You can explicitly say you're using text
display system.
Html
With %html
directive, Zeppelin treats your output as HTML
Markdown
You can render your output as markdown with the %markdown
directive.
Mathematical expressions
HTML display system automatically formats mathematical expression using MathJax. You can use
\\( INLINE EXPRESSION \\)
and $$ EXPRESSION $$
to format. For example
Table
If you have data that row separated by \n
(newline) and column separated by \t
(tab) with first row as header row, for example
You can simply use %table
display system to leverage Zeppelin's built in visualization.
If table contents start with %html
, it is interpreted as an HTML.
Note : Display system is backend independent.
Network
With the %network
directive, Zeppelin treats your output as a graph. Zeppelin can leverage the Property Graph Model.
What is the Labelled Property Graph Model?
A Property Graph is a graph that has these elements:
- a set of vertices
- each vertex has a unique identifier.
- each vertex has a set of outgoing edges.
- each vertex has a set of incoming edges.
- each vertex has a collection of properties defined by a map from key to value
- a set of edges
- each edge has a unique identifier.
- each edge has an outgoing tail vertex.
- each edge has an incoming head vertex.
- each edge has a label that denotes the type of relationship between its two vertices.
- each edge has a collection of properties defined by a map from key to value.
A Labelled Property Graph is a Property Graph where the nodes can be tagged with labels representing their different roles in the graph model
What are the APIs?
The new NETWORK visualization is based on json with the following params:
- "nodes" (mandatory): list of nodes of the graph every node can have the following params:
- "id" (mandatory): the id of the node (must be unique);
- "label": the main Label of the node;
- "labels": the list of the labels of the node;
- "data": the data attached to the node;
- "edges": list of the edges of the graph;
- "id" (mandatory): the id of the edge (must be unique);
- "source" (mandatory): the id of source node of the edge;
- "target" (mandatory): the id of target node of the edge;
- "label": the main type of the edge;
- "data": the data attached to the edge;
- "labels": a map (K, V) where K is the node label and V is the color of the node;
- "directed": (true/false, default false) wich tells if is directed graph or not;
- "types": a distinct list of the edge types of the graph
If you click on a node or edge on the bottom of the paragraph you find a list of entity properties
This kind of graph can be easily flatten in order to support other visualization formats provided by Zeppelin.
How to use it?
An example of a simple graph
%spark
print(s"""
%network {
"nodes": [
{"id": 1},
{"id": 2},
{"id": 3}
],
"edges": [
{"source": 1, "target": 2, "id" : 1},
{"source": 2, "target": 3, "id" : 2},
{"source": 1, "target": 2, "id" : 3},
{"source": 1, "target": 2, "id" : 4},
{"source": 2, "target": 1, "id" : 5},
{"source": 2, "target": 1, "id" : 6}
]
}
""")
that will look like:
A little more complex graph:
%spark
print(s"""
%network {
"nodes": [{"id": 1, "label": "User", "data": {"fullName":"Andrea Santurbano"}},{"id": 2, "label": "User", "data": {"fullName":"Lee Moon Soo"}},{"id": 3, "label": "Project", "data": {"name":"Zeppelin"}}],
"edges": [{"source": 2, "target": 1, "id" : 1, "label": "HELPS"},{"source": 2, "target": 3, "id" : 2, "label": "CREATE"},{"source": 1, "target": 3, "id" : 3, "label": "CONTRIBUTE_TO", "data": {"oldPR": "https://github.com/apache/zeppelin/pull/1582"}}],
"labels": {"User": "#8BC34A", "Project": "#3071A9"},
"directed": true,
"types": ["HELPS", "CREATE", "CONTRIBUTE_TO"]
}
""")
that will look like: