[jira] [Commented] (DAFFODIL-2003) Add Coverage Testing
[ https://issues.apache.org/jira/browse/DAFFODIL-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769360#comment-16769360 ] Josh Adams commented on DAFFODIL-2003: -- Alright, I pushed up a pull request for just the addition of the sbt-scoverage plugin as well as some instructions on using it. I'm going to create a separate ticket for getting the codecov.io stuff working. > Add Coverage Testing > > > Key: DAFFODIL-2003 > URL: https://issues.apache.org/jira/browse/DAFFODIL-2003 > Project: Daffodil > Issue Type: Improvement > Components: Infrastructure, QA >Reporter: Michael Beckerle >Assignee: Josh Adams >Priority: Minor > Attachments: scoverage-report.tar.gz > > > Test coverage report would be of value to our user community, particularly > those using Daffodil in cybersecurity applications to scrutinize data. > Synopsys Coverty is available for free for open-source projects. There may be > other tools as well, but Coverty does say it works with Scala. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (DAFFODIL-2003) Add Coverage Testing
[ https://issues.apache.org/jira/browse/DAFFODIL-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768738#comment-16768738 ] Steve Lawrence commented on DAFFODIL-2003: -- That looks really nice! I'm definitely +1 on this. Lots of benefits. This could also be a good place for new developers to get started; find a piece of untest code and figure out how to reach the code with it with a test. Requires understanding the code and writing DFDL schemas. Also, [the main scoverage page|https://github.com/scoverage/scalac-scoverage-plugin] talks about codecov.io and a way to upload coverage reports. There's already a bunch of Apache projects with Codecov.io integration: [https://codecov.io/gh/apache/]. I think it would be great to enable the scoverage plugin for Daffodil and modify our travis CI configuration to generate coverage reports for the master branch and upload them to codecov.io for every commit. And an ultimate goal would be to someday reach 100% coverage and require that pull requests add tests to maintain 100%. > Add Coverage Testing > > > Key: DAFFODIL-2003 > URL: https://issues.apache.org/jira/browse/DAFFODIL-2003 > Project: Daffodil > Issue Type: Improvement > Components: Infrastructure, QA >Reporter: Michael Beckerle >Assignee: Josh Adams >Priority: Minor > Attachments: scoverage-report.tar.gz > > > Test coverage report would be of value to our user community, particularly > those using Daffodil in cybersecurity applications to scrutinize data. > Synopsys Coverty is available for free for open-source projects. There may be > other tools as well, but Coverty does say it works with Scala. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (DAFFODIL-2003) Add Coverage Testing
[ https://issues.apache.org/jira/browse/DAFFODIL-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768671#comment-16768671 ] Josh Adams commented on DAFFODIL-2003: -- I did some playing around with the sbt-scoverage plugin and got it up and running on our code. It definitely increases the time it takes to run the tests, so I don't think we would want to enable it to always run, but it seems to do a good job creating clear coverage reports. See the attached report: [^scoverage-report.tar.gz] > Add Coverage Testing > > > Key: DAFFODIL-2003 > URL: https://issues.apache.org/jira/browse/DAFFODIL-2003 > Project: Daffodil > Issue Type: Improvement > Components: Infrastructure, QA >Reporter: Michael Beckerle >Priority: Minor > Attachments: scoverage-report.tar.gz > > > Test coverage report would be of value to our user community, particularly > those using Daffodil in cybersecurity applications to scrutinize data. > Synopsys Coverty is available for free for open-source projects. There may be > other tools as well, but Coverty does say it works with Scala. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (DAFFODIL-2003) Add Coverage Testing
[ https://issues.apache.org/jira/browse/DAFFODIL-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613612#comment-16613612 ] Steve Lawrence commented on DAFFODIL-2003: -- The [sbt-scoverage plugin|https://github.com/scoverage/sbt-scoverage] also looks promising. > Add Coverage Testing > > > Key: DAFFODIL-2003 > URL: https://issues.apache.org/jira/browse/DAFFODIL-2003 > Project: Daffodil > Issue Type: Improvement > Components: Infrastructure, QA >Reporter: Michael Beckerle >Priority: Minor > > Test coverage report would be of value to our user community, particularly > those using Daffodil in cybersecurity applications to scrutinize data. > Synopsys Coverty is available for free for open-source projects. There may be > other tools as well, but Coverty does say it works with Scala. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
