Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
rwalk committed Oct 10, 2015
1 parent 743f682 commit f607004
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,12 +13,6 @@ This project was inspired by the following excellent blog posts on streaming sea

I completed this project as a Fellow in the 2015C Inisght Data Engineering Silicon Valley program.

## Architechture
The core of the platform is an Apache Storm cluster which parallelizes the work of real-time streaming search. Internally, the Storm cluster consumes messages from a Kafka cluster and these messages are distributed to bolts which each contain a Lucene-Luwak index. The project contains a demo flask UI which handles subscriptions with a Redis PUBSUB system.

More about the architecture can be found at:
http://straw.ryanwalker.us/about

## What's included:
- Automated AWS cluster deployment utilities using boto3
- Java based Storm implementation:
Expand All @@ -31,6 +25,12 @@ http://straw.ryanwalker.us/about
- Simple Python flask web UI
- Testing and other utilities, including Docker components so that the entire topology can run on a local machine

## Architechture
The core of the platform is an Apache Storm cluster which parallelizes the work of real-time streaming search. Internally, the Storm cluster consumes messages from a Kafka cluster and these messages are distributed to bolts which each contain a Lucene-Luwak index. The project contains a demo flask UI which handles subscriptions with a Redis PUBSUB system.

More about the architecture can be found at:
http://straw.ryanwalker.us/about

## Getting started
### Running locally
1. install docker-compose and redis-server
Expand Down

0 comments on commit f607004

Please sign in to comment.