Skip to content

Commit fd2522c

Browse files
authored
New logo, updating examples and some code (#36)
1 parent bd5ac98 commit fd2522c

File tree

16 files changed

+44
-26
lines changed

16 files changed

+44
-26
lines changed

Diff for: docs/about/contact.md

+3
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,10 @@ If you have any issues with any of the particular Bullet sub-components, feel fr
1212
| UI | [https://github.com/bullet-db/bullet-ui/issues](https://github.com/bullet-db/bullet-ui/issues) |
1313
| Record | [https://github.com/bullet-db/bullet-record/issues](https://github.com/bullet-db/bullet-record/issues) |
1414
| Core | [https://github.com/bullet-db/bullet-core/issues](https://github.com/bullet-db/bullet-core/issues) |
15+
| DSL | [https://github.com/bullet-db/bullet-dsl/issues](https://github.com/bullet-db/bullet-dsl/issues) |
16+
| BQL | [https://github.com/bullet-db/bullet-bql/issues](https://github.com/bullet-db/bullet-bql/issues) |
1517
| Kafka PubSub | [https://github.com/bullet-db/bullet-kafka/issues](https://github.com/bullet-db/bullet-kafka/issues) |
18+
| Pulsar PubSub | [https://github.com/bullet-db/bullet-pulsar/issues](https://github.com/bullet-db/bullet-pulsar/issues) |
1619
| Documentation | [https://github.com/bullet-db/bullet-db.github.io/issues](https://github.com/bullet-db/bullet-db.github.io/issues) |
1720

1821
## Mailing Lists

Diff for: docs/apidocs/bullet-service/0.5.0/index.html

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
Replace me with the real documentation.

Diff for: docs/backend/storm-performance.md

+6-2
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,10 @@ Using the pluggable metrics interface in Bullet on Storm, we captured worker lev
2929

3030
See [0.3.0](https://github.com/bullet-db/bullet-storm/releases/tag/bullet-storm-0.3.0) for how to plug in your own metrics collection.
3131

32+
!!!note "Old Version of Bullet"
33+
34+
This was tested with a relatively old version of Bullet Storm and has not been updated since. With the latest changes in Storm, Bullet Storm, using a proper PubSub, and partitioning in Bullet Core, the performance is actually a lot better. However, the point of this performance section is to simply conclude that (Spoilers Ahead) scaling out is pretty linear and queries mostly fit into the overhead of reading the data when the simultaneous queries desired is in the hundreds.
35+
3236
### Tools used
3337

3438
* [jq](https://stedolan.github.io/jq/) - a nice tool to parse Bullet JSON responses
@@ -573,15 +577,15 @@ The following table summarizes the results:
573577

574578
The following figure summarizes the minimum number of CPU cores (which are also the number of Filter Bolts) needed to support the the maximum number of ```RAW``` queries with latency < 200 ms.
575579

576-
#### Figure 15. Data Volume vs Memory
580+
#### Figure 15. CPU vs Max Concurrent Queries
577581

578582
![Queries](../img/queries-cpu.png)
579583

580584
This shows that the queries supported also scale pretty linearly.
581585

582586
You may have noticed how when latency starts to increase, it increases pretty rapidly. This suggests that there is a *knee* or *exponential* curve for latency. The following figure shows this in the graph of the latency for queries with ```20``` Filter Bolts.
583587

584-
#### Figure 16. Data Volume vs Memory
588+
#### Figure 16. Max Concurrent Queries vs Latency
585589

586590
![Queries](../img/queries-20-fb.png)
587591

Diff for: docs/css/extra.css

+9
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,12 @@
1+
#bullet-logo-wrapper {
2+
text-align: center;
3+
margin-bottom: 30px;
4+
}
5+
6+
#bullet-logo {
7+
height: 200px;
8+
}
9+
110
.navbar-brand > .small-brand-text {
211
margin-left: 5px;
312
font-size: 50%;

Diff for: docs/img/bullet-logo.png

-13.7 KB
Binary file not shown.

Diff for: docs/img/bullet-logo.svg

+1
Loading

Diff for: docs/img/favicon.ico

-4.18 KB
Binary file not shown.

Diff for: docs/index.md

+2-1
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
1-
![Bullet](../img/bullet-logo.png)
1+
![Bullet](../img/bullet-logo.svg){: #bullet-logo}
2+
{: #bullet-logo-wrapper}
23

34
* A real-time query engine for very large data streams
45

Diff for: docs/quick-start/spark.md

+4-4
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ mkdir -p $BULLET_HOME/pubsub
3737
mkdir -p $BULLET_HOME/service
3838
mkdir -p $BULLET_HOME/ui
3939
cd $BULLET_HOME
40-
curl -LO https://github.com/bullet-db/bullet-db.github.io/releases/download/v0.6.0/examples_artifacts.tar.gz
40+
curl -LO https://github.com/bullet-db/bullet-db.github.io/releases/download/v0.6.1/examples_artifacts.tar.gz
4141
tar -xzf examples_artifacts.tar.gz
4242
export BULLET_EXAMPLES=$BULLET_HOME/bullet-examples
4343
```
@@ -96,7 +96,7 @@ tar -xzf spark-2.2.1-bin-hadoop2.7.tgz
9696

9797
```bash
9898
cp $BULLET_HOME/bullet-examples/backend/spark/* $BULLET_SPARK
99-
curl -Lo bullet-spark.jar http://jcenter.bintray.com/com/yahoo/bullet/bullet-spark/0.2.1/bullet-spark-0.2.1-standalone.jar
99+
curl -Lo bullet-spark.jar http://jcenter.bintray.com/com/yahoo/bullet/bullet-spark/0.2.2/bullet-spark-0.2.2-standalone.jar
100100
```
101101

102102
#### Step 8: Launch the Bullet Spark Backend
@@ -174,8 +174,8 @@ nvm use v6.9.4
174174
#### Step 13: Install the Bullet UI
175175

176176
```bash
177-
curl -LO https://github.com/bullet-db/bullet-ui/releases/download/v0.6.1/bullet-ui-v0.6.1.tar.gz
178-
tar -xzf bullet-ui-v0.6.1.tar.gz
177+
curl -LO https://github.com/bullet-db/bullet-ui/releases/download/v0.6.2/bullet-ui-v0.6.2.tar.gz
178+
tar -xzf bullet-ui-v0.6.2.tar.gz
179179
cp $BULLET_EXAMPLES/ui/env-settings.json config/
180180
```
181181

Diff for: docs/quick-start/storm.md

+6-6
Original file line numberDiff line numberDiff line change
@@ -7,13 +7,13 @@ At the end of this section, you will have:
77
* Setup the Bullet topology using a custom spout on [bullet-storm-0.8.5](https://github.com/bullet-db/bullet-storm/releases/tag/bullet-storm-0.8.5)
88
* Setup the [Web Service](../ws/setup.md) talking to the topology and serving a schema for your UI using [bullet-service-0.4.3](https://github.com/bullet-db/bullet-service/releases/tag/bullet-service-0.4.3)
99
* Setup the [REST PubSub](../pubsub/rest.md) talking to the topology and Web Service using [bullet-core-0.6.4](https://github.com/bullet-db/bullet-core/releases/tag/bullet-core-0.6.4).
10-
* Setup the [UI](../ui/setup.md) talking to the Web Service using [bullet-ui-0.6.1](https://github.com/bullet-db/bullet-ui/releases/tag/v0.6.1)
10+
* Setup the [UI](../ui/setup.md) talking to the Web Service using [bullet-ui-0.6.2](https://github.com/bullet-db/bullet-ui/releases/tag/v0.6.2)
1111

1212
**Prerequisites**
1313

1414
* You will need to be on an Unix-based system (Mac OS X, Ubuntu ...) with ```curl``` installed
1515
* You will need [JDK 8](http://www.oracle.com/technetwork/java/javase/downloads/index.html) installed
16-
* You will need enough CPU and RAM on your machine to run about 8-10 JVMs in ```server``` mode. You should have at least 2 GB free space on your disk. We will be setting up a Storm cluster with multiple components, a couple of Jetty instances and a Node server.
16+
* You will need enough CPU and RAM on your machine to run about 8-10 JVMs in ```server``` mode. You should have at least 2 GB free space on your disk. We will be setting up a Storm cluster with multiple components, an embedded Tomcat server and a Node server.
1717

1818
## Install Script
1919

@@ -43,7 +43,7 @@ mkdir -p $BULLET_HOME/backend/storm
4343
mkdir -p $BULLET_HOME/service
4444
mkdir -p $BULLET_HOME/ui
4545
cd $BULLET_HOME
46-
curl -LO https://github.com/bullet-db/bullet-db.github.io/releases/download/v0.6.0/examples_artifacts.tar.gz
46+
curl -LO https://github.com/bullet-db/bullet-db.github.io/releases/download/v0.6.1/examples_artifacts.tar.gz
4747
tar -xzf examples_artifacts.tar.gz
4848
export BULLET_EXAMPLES=$BULLET_HOME/bullet-examples
4949
```
@@ -168,8 +168,8 @@ nvm use v6.9.4
168168

169169
```bash
170170
cd $BULLET_HOME/ui
171-
curl -LO https://github.com/bullet-db/bullet-ui/releases/download/src/bullet-ui-v0.6.1.tar.gz
172-
tar -xzf bullet-ui-v0.6.1.tar.gz
171+
curl -LO https://github.com/bullet-db/bullet-ui/releases/download/src/bullet-ui-v0.6.2.tar.gz
172+
tar -xzf bullet-ui-v0.6.2.tar.gz
173173
cp $BULLET_EXAMPLES/ui/env-settings.json config/
174174
```
175175

@@ -204,7 +204,7 @@ If you were performing the steps yourself, you can also manually cleanup **all t
204204
| UI | ```pkill -f [e]xpress-server.js``` |
205205
| Web Service | ```pkill -f [e]xample_rest_pubsub_config.yaml``` |
206206
| Storm | ```pkill -f [a]pache-storm-1.2.2``` |
207-
| File System | ```rm -rf $BULLET_HOME /tmp/dev-storm-zookeeper /tmp/jetty-*``` |
207+
| File System | ```rm -rf $BULLET_HOME /tmp/dev-storm-zookeeper``` |
208208

209209
This does *not* delete ```$HOME/.nvm``` and some extra lines nvm may have added to your ```$HOME/{.profile, .bash_profile, .zshrc, .bashrc}```.
210210

Diff for: docs/releases.md

+2
Original file line numberDiff line numberDiff line change
@@ -149,6 +149,7 @@ The Web Service implementation that can serve a static schema from a file and ta
149149

150150
| Date | Release | Highlights | APIDocs |
151151
| ------------ | -------------------------------------------------------------------------------------- | ---------- | ------- |
152+
| 2019-03-07 | [**0.5.0**](https://github.com/bullet-db/bullet-service/releases/tag/bullet-service-0.5.0) | QueryManager API updates | [JavaDocs](apidocs/bullet-service/0.5.0/index.html) |
152153
| 2018-11-28 | [**0.4.3**](https://github.com/bullet-db/bullet-service/releases/tag/bullet-service-0.4.3) | Updates bullet-bql to 0.2.1 | [JavaDocs](apidocs/bullet-service/0.4.3/index.html) |
153154
| 2018-11-26 | [**0.4.2**](https://github.com/bullet-db/bullet-service/releases/tag/bullet-service-0.4.2) | BQL to JSON endpoint, dead backend reaper, new types in Schema, bullet-core 0.6.4 | [JavaDocs](apidocs/bullet-service/0.4.2/index.html) |
154155
| 2018-09-06 | [**0.4.1**](https://github.com/bullet-db/bullet-service/releases/tag/bullet-service-0.4.1) | Max Queries limit and bullet-bql 0.1.2 | [JavaDocs](apidocs/bullet-service/0.4.1/index.html) |
@@ -179,6 +180,7 @@ The Bullet UI that lets you build, run, save and visualize results from Bullet.
179180

180181
| Date | Release | Highlights |
181182
| ------------ | -------------------------------------------------------------------------------------- | ---------- |
183+
| 2019-03-18 | [**0.6.2**](https://github.com/bullet-db/bullet-ui/releases/tag/v0.6.2) | Logo update |
182184
| 2018-10-05 | [**0.6.1**](https://github.com/bullet-db/bullet-ui/releases/tag/v0.6.1) | Timeseries Graphing, Bar, Pie Charts and FontAwesome |
183185
| 2018-07-20 | [**0.6.0**](https://github.com/bullet-db/bullet-ui/releases/tag/v0.6.0) | Supports adding a full default starting query |
184186
| 2018-06-18 | [**0.5.0**](https://github.com/bullet-db/bullet-ui/releases/tag/v0.5.0) | Supports windowing, uses IndexedDB and Ember 3! |

Diff for: examples/install-all-spark.sh

+3-3
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,11 @@
22

33
set -euo pipefail
44

5-
BULLET_EXAMPLES_VERSION=0.6.0
6-
BULLET_UI_VERSION=0.6.1
5+
BULLET_EXAMPLES_VERSION=0.6.1
6+
BULLET_UI_VERSION=0.6.2
77
BULLET_WS_VERSION=0.4.3
88
BULLET_KAFKA_VERSION=0.3.2
9-
BULLET_SPARK_VERSION=0.2.1
9+
BULLET_SPARK_VERSION=0.2.2
1010
KAFKA_VERSION=0.11.0.1
1111
SPARK_VERSION=2.2.1
1212
NVM_VERSION=0.33.1

Diff for: examples/install-all-storm.sh

+2-2
Original file line numberDiff line numberDiff line change
@@ -2,8 +2,8 @@
22

33
set -euo pipefail
44

5-
BULLET_EXAMPLES_VERSION=0.6.0
6-
BULLET_UI_VERSION=0.6.1
5+
BULLET_EXAMPLES_VERSION=0.6.1
6+
BULLET_UI_VERSION=0.6.2
77
BULLET_WS_VERSION=0.4.3
88
STORM_VERSION=1.2.2
99
NVM_VERSION=0.33.1

Diff for: examples/spark/pom.xml

+1-2
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
<scala.version>2.11.7</scala.version>
1111
<scala.dep.version>2.11</scala.dep.version>
1212
<spark.version>2.3.0</spark.version>
13-
<bullet.spark.version>0.1.2</bullet.spark.version>
13+
<bullet.spark.version>0.2.2</bullet.spark.version>
1414
<bullet.record.version>0.2.0</bullet.record.version>
1515
</properties>
1616

@@ -81,4 +81,3 @@
8181
</plugins>
8282
</build>
8383
</project>
84-

Diff for: examples/storm/src/main/java/com/yahoo/bullet/storm/examples/RandomSpout.java

+2-5
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,7 @@
1515
import org.apache.storm.topology.base.BaseRichSpout;
1616
import org.apache.storm.tuple.Fields;
1717
import org.apache.storm.tuple.Values;
18+
import org.apache.storm.utils.Utils;
1819

1920
import java.io.IOException;
2021
import java.util.HashMap;
@@ -132,11 +133,7 @@ public void nextTuple() {
132133
periodCount++;
133134
}
134135
// It is courteous to sleep for a short time if you're not emitting anything...
135-
try {
136-
Thread.sleep(1);
137-
} catch (InterruptedException e) {
138-
log.error("Error: ", e);
139-
}
136+
Utils.sleep(1);
140137
}
141138

142139
private Map<String, String> makeRandomMap() {

Diff for: mkdocs.yml

+2-1
Original file line numberDiff line numberDiff line change
@@ -45,11 +45,12 @@ pages:
4545

4646
markdown_extensions:
4747
- admonition
48+
- attr_list
4849

4950
extra:
5051
collapse_toc: true
5152
include_search: true
52-
service_version: v0.6.0
53+
service_version: v0.6.1
5354

5455
extra_css:
5556
- css/extra.css

0 commit comments

Comments
 (0)