package partitions
- Alphabetic
- By Inheritance
- partitions
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
- final case class AppendData[A, K](bucket: K, record: A) extends PartitionEvent[A, K] with Product with Serializable
- final case class FlushBucket[A, K](bucket: K) extends PartitionEvent[A, K] with Product with Serializable
- final case class ForceFlushBuckets[A, K](signalComplete: Boolean) extends PartitionEvent[A, K] with Product with Serializable
- trait HasTimestamp[A] extends AnyRef
- final case class MiniBatchState[A, K] extends Product with Serializable
State which represents the consumption of 'ConsumerRecords' from kafka and partition them into buckets.
State which represents the consumption of 'ConsumerRecords' from kafka and partition them into buckets.
Each bucket should be represented as an observable of some kind of data structure which contains the ConsumerRecords that completes once we've consumed all* the records from the time bucket (e.g. if we want to partition the data into 10 minute segments, one partition would contain the records from 8:10 to 8:20)
- sealed trait PartitionEvent[A, K] extends AnyRef
The data passing through will be partitioned into different buckets.
The data passing through will be partitioned into different buckets. At some point we'll acknowledge that there won't be anymore records coming through for a particular bucket (partition)
- trait Partitioner[A, B] extends AnyRef
A means to place values of type A into buckets of type B
- final case class TimeBucket(hour: Int, fromMinute: Int, toMinute: Int) extends Product with Serializable
Value Members
- val UTC: ZoneId
- def utcForEpochMillis(epochMilli: Long): ZonedDateTime
- object HasTimestamp
- object MiniBatchState extends Serializable
- object Partitioner
- object TimeBucket extends Serializable