RE: what are common ways to convert info on a web site into a log entry?

I would have a cron that runs every day but somehow tracks if it has pulled data for the month. If it has it just does nothing. This way if you have some sort of failure one day (website is down, etc ...) it would pull data the next day. You could possibly use Kaka itself to store the last

what are common ways to convert info on a web site into a log entry?

Hi Kafka people, I am very new to kafka, so perhaps my question is naive. I spent some time searching around at resources of kafka but only became more confused. What are common ways to pull info from a web site and send to kafka to become a log entry? There is a web site that I want to pull a

Re: what are common ways to convert info on a web site into a log entry?

thanks! I will write my reply into the mail group once I have fiddled with your suggestions. James. > On Jan 15, 2018, at 2:20 PM, Jacob Sheck wrote: > > You will need to find or create something to accomplish this. Topics in > Kafka primarily act as queues. If you

Re: what are common ways to convert info on a web site into a log entry?

You will need to find or create something to accomplish this. Topics in Kafka primarily act as queues. If you search the web for more information about "kafka connector http" you will find a few projects that do this. You could also take a look at the Confluent S3 Connector as an example of how

what are common ways to convert info on a web site into a log entry?

Hi Kafka people, I am very new to kafka, so perhaps my question is naive. I spent some time searching around at resources of kafka but only became more confused. What are common ways to pull info from a web site and send to kafka to become a log entry? There is a web site that I want to pull a