aws-kinesis

Create a new data stream

$ aws kinesis create-stream --stream-name [my-stream] --shard-count 1

$ aws kinesis list-streams

$ aws kinesis put-record --stream-name [my-stream] --partition-key [key1] --data "[message data]"

$ aws kinesis get-shard-iterator --stream-name [my-stream] --shard-id [shardId-000000000000] --shard-iterator-type TRIM_HORIZON

$ aws kinesis get-records --shard-iterator [shard-iterator-value]

$ aws kinesis describe-stream --stream-name [my-stream]

$ aws kinesis increase-stream-retention-period --stream-name [my-stream] --retention-period-hours 168

$ aws kinesis delete-stream --stream-name [my-stream]

aws kinesis command [options]

aws kinesis is the AWS CLI interface for Amazon Kinesis Data Streams, a serverless service for real-time data streaming. Kinesis ingests and processes large amounts of data in real-time from sources like website clickstreams, IoT telemetry, and application logs.
Data streams consist of shards that provide throughput capacity. Each shard supports 1 MB/sec write and 2 MB/sec read. Kinesis retains data for 24 hours by default, extendable to 365 days for replay scenarios.

create-stream

Create a new data stream

Delete a stream

Get stream configuration and status

List all streams

Write a single record

Write multiple records in a batch

Get iterator for reading from a shard

Retrieve records using an iterator

Scale stream capacity

Enable server-side encryption

Register an enhanced fan-out consumer

Shard iterators expire after 5 minutes. Each shard has throughput limits; exceeding them causes throttling. Record size is limited to 1 MB. GetRecords returns up to 10 MB or 10,000 records per call. Enhanced fan-out consumers have additional costs but dedicated throughput.

Amazon Kinesis launched in November 2013 as a real-time data streaming service. Enhanced fan-out was added in 2018 for dedicated consumer throughput. On-demand capacity mode launched in 2021, eliminating the need to manage shard counts manually.

aws(1), aws-firehose(1), aws-kafka(1)