vvraskin opened a new pull request #3552: Emit activation metadata to Kafka
URL: https://github.com/apache/incubator-openwhisk/pull/3552
 
 
   <!--- Provide a concise summary of your changes in the Title -->
   
   ## Description
   <!--- Provide a detailed description of your changes. -->
   <!--- Include details of what problem you are solving and how your changes 
are tested. -->
   This PR enables sending activation metadata to Kafka, which might be helpful 
to alleviate the exertion of CouchDB we observe today as well as to preserve 
user activations metadata for real time processing. 
   
   At the moment I introduce a new kafka topic called `events` which will 
accept events of 2 types: Activations and Metrics. First corresponds to the 
metadata which is collected after an activation is finished (initTime, 
waitTime, responseCode, kind, etc), second stands for User related metrics of 
any kind (throttledActivations, concurrentActivations). The data is not 
aggregated, it is sent to Kafka instantly. 
   
   
   ## My changes affect the following components
   <!--- Select below all system components are affected by your change. -->
   <!--- Enter an `x` in all applicable boxes. -->
   - [ ] API
   - [x] Controller
   - [x] Message Bus (e.g., Kafka)
   - [ ] Loadbalancer
   - [x] Invoker
   - [ ] Intrinsic actions (e.g., sequences, conductors)
   - [ ] Data stores (e.g., CouchDB)
   - [ ] Tests
   - [ ] Deployment
   - [ ] CLI
   - [ ] General tooling
   - [ ] Documentation
   
   ## Types of changes
   <!--- What types of changes does your code introduce? Use `x` in all the 
boxes that apply: -->
   - [ ] Bug fix (generally a non-breaking change which closes an issue).
   - [x] Enhancement or new feature (adds new functionality).
   - [ ] Breaking change (a bug fix or enhancement which changes existing 
behavior).
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to