Package org.apache.cassandra.spark.bulkwriter.cloudstorage

Class DataChunker

  • public class DataChunker
extends java.lang.Object
    DataChunker helps break down data into chunks according to maxChunkSizeInBytes set.

    • Constructor Summary

      Constructors 
      Constructor Description
      DataChunker​(int chunkSizeInBytes)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.util.Iterator<java.nio.ByteBuffer> chunks​(java.nio.channels.ReadableByteChannel channel)
      Chunk the input stream based on chunkSize

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • DataChunker

        public DataChunker​(int chunkSizeInBytes)

    • Method Detail

      • chunks

        public java.util.Iterator<java.nio.ByteBuffer> chunks​(java.nio.channels.ReadableByteChannel channel)
        Chunk the input stream based on chunkSize
        Parameters:
        channel - data source file channel
        Returns:
        iterator of ByteBuffers. Call-sites should check Buffer.limit() to determine how much data to read, especially the last chunk