org.apache.storm.sql.hdfs

Class HdfsDataSourcesProvider

java.lang.Object

org.apache.storm.sql.hdfs.HdfsDataSourcesProvider

All Implemented Interfaces:

DataSourcesProvider

public class HdfsDataSourcesProvider
extends Object
implements DataSourcesProvider

Create a HDFS sink based on the URI and properties. The URI has the format of hdfs://host:port/path-to-file The properties are in JSON format which specifies the name / path of the hdfs file and etc.

Constructor Summary

Constructors

Constructor and Description
HdfsDataSourcesProvider()

Method Summary

Modifier and Type	Method and Description
DataSource	construct(URI uri, String inputFormatClass, String outputFormatClass, List<FieldInfo> fields) Construct a new data source.
ISqlTridentDataSource	constructTrident(URI uri, String inputFormatClass, String outputFormatClass, Properties properties, List<FieldInfo> fields)
String	scheme()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HdfsDataSourcesProvider

public HdfsDataSourcesProvider()

Method Detail

scheme

public String scheme()

Specified by:

scheme in interface DataSourcesProvider

Returns:

the scheme of the data source

construct

public DataSource construct(URI uri,
                            String inputFormatClass,
                            String outputFormatClass,
                            List<FieldInfo> fields)

Description copied from interface: DataSourcesProvider

Construct a new data source.

Specified by:

construct in interface DataSourcesProvider

Parameters:

uri - The URI that specifies the data source. The format of the URI is fully customizable.

inputFormatClass - the name of the class that deserializes data. It is null when unspecified.

outputFormatClass - the name of the class that serializes data. It is null when unspecified.

fields - The name of the fields and the schema of the table.

constructTrident

public ISqlTridentDataSource constructTrident(URI uri,
                                              String inputFormatClass,
                                              String outputFormatClass,
                                              Properties properties,
                                              List<FieldInfo> fields)

Specified by:

constructTrident in interface DataSourcesProvider