Package org.apache.storm.hive.common
Class HiveWriter
java.lang.Object
org.apache.storm.hive.common.HiveWriter
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic classstatic classstatic classstatic classstatic classstatic class -
Field Summary
Fields -
Constructor Summary
ConstructorsConstructorDescriptionHiveWriter(org.apache.hive.hcatalog.streaming.HiveEndPoint endPoint, int txnsPerBatch, boolean autoCreatePartitions, long callTimeout, ExecutorService callTimeoutPool, HiveMapper mapper, org.apache.hadoop.security.UserGroupInformation ugi, boolean tokenAuthEnabled) -
Method Summary
Modifier and TypeMethodDescriptionvoidabort()Aborts the current Txn and switches to next Txn.voidclose()Close the Transaction Batch and connection.voidflush(boolean rollToNext) Commits the current Txn if totalRecordsPerTransaction > 0 .voidFlush and Close current transactionBatch.longorg.apache.hive.hcatalog.streaming.RecordWritergetRecordWriter(HiveMapper mapper, boolean tokenAuthEnabled) intreturns totalRecords written so far in a transaction.voidQueues up a heartbeat request on the current and remaining txns using the heartbeatThdPool and returns immediately.toString()voidwrite(byte[] record) Write data.
-
Field Details
-
closed
protected boolean closed
-
-
Constructor Details
-
HiveWriter
public HiveWriter(org.apache.hive.hcatalog.streaming.HiveEndPoint endPoint, int txnsPerBatch, boolean autoCreatePartitions, long callTimeout, ExecutorService callTimeoutPool, HiveMapper mapper, org.apache.hadoop.security.UserGroupInformation ugi, boolean tokenAuthEnabled) throws InterruptedException, HiveWriter.ConnectFailure
-
-
Method Details
-
getRecordWriter
public org.apache.hive.hcatalog.streaming.RecordWriter getRecordWriter(HiveMapper mapper, boolean tokenAuthEnabled) throws Exception - Throws:
Exception
-
toString
-
write
public void write(byte[] record) throws HiveWriter.WriteFailure, org.apache.hive.hcatalog.streaming.SerializationError, InterruptedException Write data.- Throws:
HiveWriter.WriteFailureorg.apache.hive.hcatalog.streaming.SerializationErrorInterruptedException
-
flush
public void flush(boolean rollToNext) throws HiveWriter.CommitFailure, HiveWriter.TxnBatchFailure, HiveWriter.TxnFailure, InterruptedException Commits the current Txn if totalRecordsPerTransaction > 0 . If 'rollToNext' is true, will switch to next Txn in batch or to a new TxnBatch if current Txn batch is exhausted -
heartBeat
Queues up a heartbeat request on the current and remaining txns using the heartbeatThdPool and returns immediately.- Throws:
InterruptedException
-
getTotalRecords
public int getTotalRecords()returns totalRecords written so far in a transaction. -
flushAndClose
public void flushAndClose() throws HiveWriter.TxnBatchFailure, HiveWriter.TxnFailure, HiveWriter.CommitFailure, IOException, InterruptedExceptionFlush and Close current transactionBatch. -
close
Close the Transaction Batch and connection.- Throws:
IOExceptionInterruptedException
-
abort
public void abort() throws org.apache.hive.hcatalog.streaming.StreamingException, HiveWriter.TxnBatchFailure, InterruptedExceptionAborts the current Txn and switches to next Txn.- Throws:
org.apache.hive.hcatalog.streaming.StreamingException- if could not get new Transaction Batch, or switch to next TxnHiveWriter.TxnBatchFailureInterruptedException
-
getLastUsed
public long getLastUsed()
-