Will-Lo commented on code in PR #3610:
URL: https://github.com/apache/gobblin/pull/3610#discussion_r1042556772
##########
gobblin-metrics-libs/gobblin-metrics-base/src/main/avro/GaaSObservabilityEventV0.avsc:
##########
@@ -0,0 +1,135 @@
+{
+ "type": "record",
+ "name": "GaaSObservabilityEventExperimental",
+ "namespace" : "org.apache.gobblin.metrics",
+ "doc": "An experimental feature for GaaS to emit events during and after a
job is executed.",
+ "fields": [
+ {
+ "name": "timestamp",
+ "type": "long",
+ "doc": "Time at which event was created in millis"
+ }, {
+ "name" : "flowGroup",
+ "type" : "string",
+ "doc" : "Flow group for the GaaS flow",
+ "compliance" : "NONE"
+ }, {
+ "name" : "flowName",
+ "type" : "string",
+ "doc" : "Flow name for the GaaS flow",
+ "compliance" : "NONE"
+ }, {
+ "name" : "flowExecutionId",
+ "type" : "long",
+ "doc" : "Flow execution id for the GaaS flow",
+ "compliance" : "NONE"
+ }, {
+ "name": "jobOrchestratedTime",
+ "type": "long",
+ "doc": "Timestamp when the job was successfully sent to the job
executor, -1 if it was unable to be sent."
+ }, {
+ "name": "lastFlowModificationTime",
+ "type": "long",
+ "doc": "Timestamp in millis when the flow config was last modified"
+ }, {
+ "name" : "flowGraphEdgeId",
+ "type" : "string",
+ "doc" : "Flow edge id, in format <src_node>_<dest_node>_<edge_id>",
+ "compliance" : "NONE"
+ }, {
+ "name": "jobName",
+ "type": "string",
+ "doc": "The name of the Gobblin job, found in the job template. One edge
can contain multiple jobs",
+ "compliance" : "NONE"
+ }, {
+ "name": "jobStatus",
+ "type": {
+ "type": "enum",
+ "name": "JobStatus",
+ "symbols": [
+ "SUCCEEDED",
+ "FAILED",
+ "CANCELLED"
+ ],
+ "doc": "Final job status for this job in the GaaS flow",
+ "compliance": "NONE"
+ }
+ }, {
+ "name": "jobStartTime",
+ "type": "long",
+ "doc": "Start time of the job in millis",
+ "compliance": "NONE"
+ }, {
+ "name": "jobEndTime",
+ "type": "long",
+ "doc": "Finish time of the job in millis",
+ "compliance": "NONE"
+ }, {
+ "name": "proxyUser",
+ "type": "string",
+ "doc": "Proxy user (if applicable) that ran the Gobblin job",
Review Comment:
What about GaaS executors that take no proxy user? It's an Azkaban/HDFS
concept.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@gobblin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
