Basics of Storm

• Javadoc
• Tutorial
• Concepts
• Scheduler
• Configuration
• Guaranteeing message processing
• Daemon Fault Tolerance
• Command line client
• REST API
• Understanding the parallelism of a Storm topology
• FAQ

Layers on top of Storm

Trident

Trident is an alternative interface to Storm. It provides exactly-once processing, “transactional” datastore persistence, and a set of common stream analytics operations.

• Trident Tutorial – basic concepts and walkthrough
• Trident API Overview – operations for transforming and orchestrating data
• Trident State – exactly-once processing and fast, persistent aggregation
• Trident spouts – transactional and non-transactional data intake
• Trident RAS API – using the Resource Aware Scheduler with Trident.

Streams API

Stream APIs is another alternative interface to Storm. It provides a typed API for expressing streaming computations and supports functional style operations.

NOTE: Streams API is an experimental feature, and further works might break backward compatibility. We’re also notifying it via annotating classes with marker interface @InterfaceStability.Unstable.

• Streams API

SQL

The Storm SQL integration allows users to run SQL queries over streaming data in Storm.

NOTE: Storm SQL is an experimental feature, so the internals of Storm SQL and supported features are subject to change. But small change will not affect the user experience. We will notify the user when breaking UX change is introduced.

• Storm SQL overview
• Storm SQL example
• Storm SQL reference
• Storm SQL internal

Flux

• Flux Data Driven Topology Builder

Setup and Deploying

• Setting up a Storm cluster
• Local mode
• Troubleshooting
• Running topologies on a production cluster
• Building Storm with Maven
• Setting up a Secure Cluster
• CGroup Enforcement
• Pacemaker reduces load on zookeeper for large clusters
• Resource Aware Scheduler
• Generic Resources
• Daemon Metrics/Monitoring
• Windows users guide
• Classpath handling

Intermediate

• Serialization
• Common patterns
• DSLs and multilang adapters
• Using non-JVM languages with Storm
• Distributed RPC
• Hooks
• Metrics (Deprecated)
• Metrics V2
• State Checkpointing
• Windowing
• Joining Streams
• Blobstore(Distcache)

Debugging

• Dynamic Log Level Settings
• Searching Worker Logs
• Worker Profiling
• Event Logging

Integration With External Systems, and Other Libraries

• Apache Kafka Integration
• Apache HBase Integration
• Apache HDFS Integration
• Apache Hive Integration
• Apache Solr Integration
• Apache Cassandra Integration
• Apache RocketMQ Integration
• JDBC Integration
• JMS Integration
• MQTT Integration
• Redis Integration
• Event Hubs Intergration
• Elasticsearch Integration
• Mongodb Integration
• OpenTSDB Integration
• Kinesis Integration
• PMML Integration
• Kestrel Integration

Container, Resource Management System Integration

• YARN Integration
• Mesos Integration
• Docker Integration
• Kubernetes Integration

Advanced

• Defining a non-JVM language DSL for Storm
• Multilang protocol (how to provide support for another language)
• Implementation docs
• Storm Metricstore