[jira] [Created] (PIG-4809) Implement to collect metric data like getSMMSpillCount() in SparkJobStats

[liyunzhang_intel (JIRA)]

liyunzhang_intel created PIG-4809:
-------------------------------------

             Summary: Implement to collect metric data like getSMMSpillCount() 
in SparkJobStats
                 Key: PIG-4809
                 URL: https://issues.apache.org/jira/browse/PIG-4809
             Project: Pig
          Issue Type: Sub-task
          Components: spark
            Reporter: liyunzhang_intel


In current code, we don't implement to collect metric data in SparkJobStats 
like:
SparkJobStats#getSMMSpillCount:
{code}
    @Override
    public long getSMMSpillCount() {
        throw new UnsupportedOperationException();
    }
{code}

We just throw UnsupportedOperationException when this function is called. 
We need implement following functions in SparkJobStats if the metric data can 
be collected in spark mode:
{code}
    @Override
    public int getNumberMaps() {
        throw new UnsupportedOperationException();
    }

    @Override
    public int getNumberReduces() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMaxMapTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMinMapTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getAvgMapTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMaxReduceTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMinReduceTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getAvgREduceTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMapInputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMapOutputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getReduceInputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getReduceOutputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getSMMSpillCount() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getProactiveSpillCountObjects() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getProactiveSpillCountRecs() {
        throw new UnsupportedOperationException();
    }

  @Override
    public Map<String, Long> getMultiStoreCounters() {
        throw new UnsupportedOperationException();
    }

    @Override
    public Map<String, Long> getMultiInputCounters() {
        throw new UnsupportedOperationException();
    }
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)