package io
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
- trait Appender[A] extends AutoCloseable
Represents a sink for writing values to some persistent source
- case class Base64Writer[A](dir: Path, recordsReceivedBeforeClosingBucket: Int, numberOfAppendsBeforeWriterFlush: Int, timeBucketMinutes: Int, flushEvery: Int, limit: Option[Long])(implicit evidence$1: HasTimestamp[A], evidence$2: Show[A]) extends Product with Serializable
An ETL configuration which will take Kafka records and write them to some directory
An ETL configuration which will take Kafka records and write them to some directory
- A
the record type
- dir
the directory to write the buckets under
- recordsReceivedBeforeClosingBucket
see comments in reference.conf
- numberOfAppendsBeforeWriterFlush
see comments in reference.conf
- timeBucketMinutes
see comments in reference.conf
- class TextAppenderObserver[A] extends Observer[A] with Appender[A] with StrictLogging
- class ZipAppenderObserver[A] extends Observer[A] with Appender[A] with AutoCloseable with StrictLogging
Value Members
- object Base64Writer extends StrictLogging with Serializable
- object FileSink
Means to write data to zips
- object FileSource
A means to get a stream of data from a directory, if only to make kafka4m useful out-of-the-box.
A means to get a stream of data from a directory, if only to make kafka4m useful out-of-the-box.
This way we can get a stream of data from each file
- object TextAppenderObserver extends Serializable
A namespace which holds a 'fromEvents' as a means to transform append events into time-bucketed files
- object ZipAppenderObserver extends Serializable