Packages

p

kafka4m

partitions

package partitions

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. partitions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. final case class AppendData[A, K](bucket: K, record: A) extends PartitionEvent[A, K] with Product with Serializable
  2. final case class FlushBucket[A, K](bucket: K) extends PartitionEvent[A, K] with Product with Serializable
  3. final case class ForceFlushBuckets[A, K](signalComplete: Boolean) extends PartitionEvent[A, K] with Product with Serializable

  4. trait HasTimestamp[A] extends AnyRef
  5. final case class MiniBatchState[A, K] extends Product with Serializable

    State which represents the consumption of 'ConsumerRecords' from kafka and partition them into buckets.

    State which represents the consumption of 'ConsumerRecords' from kafka and partition them into buckets.

    Each bucket should be represented as an observable of some kind of data structure which contains the ConsumerRecords that completes once we've consumed all* the records from the time bucket (e.g. if we want to partition the data into 10 minute segments, one partition would contain the records from 8:10 to 8:20)

  6. sealed trait PartitionEvent[A, K] extends AnyRef

    The data passing through will be partitioned into different buckets.

    The data passing through will be partitioned into different buckets. At some point we'll acknowledge that there won't be anymore records coming through for a particular bucket (partition)

  7. trait Partitioner[A, B] extends AnyRef

    A means to place values of type A into buckets of type B

  8. final case class TimeBucket(hour: Int, fromMinute: Int, toMinute: Int) extends Product with Serializable

Value Members

  1. val UTC: ZoneId
  2. def utcForEpochMillis(epochMilli: Long): ZonedDateTime
  3. object HasTimestamp
  4. object MiniBatchState extends Serializable
  5. object Partitioner
  6. object TimeBucket extends Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped