[CONF] Apache Samza > SEP-26: Azure Blob Storage Producer

[Lakshmi Manasa Gaduputi (Confluence)]

Title: Message Title

There's 4 new inline comments on this page

SEP-26: Azure Blob Storage Producer Prateek Maheshwari block(stageBlock) What does this mean? Lakshmi Manasa Gaduputi block is part of the blob.. stageBlock is the Azure API to upload the block. reworded to avoid confusion. View comment • Like Prateek Maheshwari Stream/Partition/timestamp What does partition mean? Why do we have a timestamp? Do you mean the blob name actually includes slashes as the separator? Lakshmi Manasa Gaduputi Samza SystemProducers get the message as an OutgoingMessageEnvelope which has an SSP. This producer, uses those fields to identify the Azure container and form a blob. Yes, they can. If two tasks produce to the same SSP then two different blobs will be created with the same prefix of stream/partition but different timestamps. However, its recommended to turn on the config to add a random string suffix to avoid blob name collisions. View comment • Like Prateek Maheshwari for each stream Do you mean each Stream-Partition? Lakshmi Manasa Gaduputi yes, thanks for catching this. will update View comment • Like Prateek Maheshwari Hence timestamp What time is this? Time of commit? First message sent after a commit? Lakshmi Manasa Gaduputi its the time the first message is received after a system producer flush. So yes, time of first message sent after commit. Updating to include this info View comment • Like View page

Stop watching space • Manage notifications This message was sent by Atlassian Confluence 7.1.2