Re: [CODE4LIB] Qualitative Analysis software and is there a Qualitative Data equivalent to CKAN

2022-09-22 Thread Eric Lease Morgan
On Sep 22, 2022, at 4:01 PM, Jodi Schneider  wrote:

> There is some work comparing topic modeling to qualitative analysis. Here
> are two papers I'd suggest:
> 
> Baumer, Eric P. S., David Mimno, Shion Guha, Emily Quan, and Geri K. Gay.
> “Comparing Grounded Theory and Topic Modeling: Extreme Divergence or
> Unlikely Convergence?” Journal of the Association for Information Science
> and Technology 68, no. 6 (2017): 1397–1410.
> https://doi.org/10.1002/asi.23786
> 
> Roberts, Margaret E., Brandon M. Stewart, Dustin Tingley, Christopher
> Lucas, Jetson Leder-Luis, Shana Kushner Gadarian, Bethany Albertson, and
> David G. Rand. “Structural Topic Models for Open-Ended Survey Responses.”
> American Journal of Political Science 58, no. 4 (2014): 1064–82.
> https://doi.org/10./ajps.12103


Jodi, thank you for bringing these to our attention.

I'd like to double suggest the article by Roberts because it outlines a 
technique I use often. More specifically, I often use MALLET to topic model a 
corpus, and this results in a sort of document-term matrix. This matrix can be 
augmented with metadata values such as date, author, genre, gender, 
nationality, etc. The matrix can then be pivoted and visualized thus 
illustrating how different topics correspond to different metadata values. 
Using this technique one can plot the ebb & flow of ideas ("topics") over time, 
across genders, between nationalities, etc. For example, I might topic model 
works by Longfellow, Emerson, Thoreau, Austen, and Melville. Using the 
technique outlined above and alluded to in the Roberts article, one can then 
illustrate how these authors compare & contrast. 

--
Eric Lease Morgan
Navari Family Center for Digital Scholarship
University of Notre Dame


Re: [CODE4LIB] Qualitative Analysis software and is there a Qualitative Data equivalent to CKAN

2022-09-22 Thread Jodi Schneider
There is some work comparing topic modeling to qualitative analysis. Here
are two papers I'd suggest:

Baumer, Eric P. S., David Mimno, Shion Guha, Emily Quan, and Geri K. Gay.
“Comparing Grounded Theory and Topic Modeling: Extreme Divergence or
Unlikely Convergence?” Journal of the Association for Information Science
and Technology 68, no. 6 (2017): 1397–1410.
https://doi.org/10.1002/asi.23786

Roberts, Margaret E., Brandon M. Stewart, Dustin Tingley, Christopher
Lucas, Jetson Leder-Luis, Shana Kushner Gadarian, Bethany Albertson, and
David G. Rand. “Structural Topic Models for Open-Ended Survey Responses.”
American Journal of Political Science 58, no. 4 (2014): 1064–82.
https://doi.org/10./ajps.12103

I'd welcome others!

-Jodi

On Mon, Sep 12, 2022 at 9:40 AM Eric Lease Morgan  wrote:

> On Sep 9, 2022, at 11:25 AM, Kimberli Kelmor <
> 00bb820b18d8-dmarc-requ...@lists.clir.org> wrote:
>
> > A while back we kind of talked around qualitative analysis tools. I'd
> like to query the group about it directly, though.
> >
> > What do people use for qualitative data analysis and storage? I've used
> NVivo before and liked it, but it is pricey and maybe both under and
> overkill. What else is out there?
> >
> > A related question, is there an open data platform that is geared toward
> qualitative data instead of quantitative data? I'm looking to find
> something already available that has a strong data/document repository
> layer, a strong analysis layer, and a strong and flexible presentation or
> publishing layer.
> >
> > Many thanks for any information you can share!
> >
> > --
> > Kimberli M. Kelmor
>
>
> Please correct me if I'm wrong. In this case, "qualitative analysis tools"
> are applications where one: 1) assembles a corpus of one or more documents,
> 2) articulates a vocabulary of topics or themes, 3) peruses ("reads") items
> in the corpus assigning vocabulary terms to parts or the whole of the
> items, and 4) does statistical analysis against the assignments. In the end
> the student, researcher, or scholar will address questions such as "How did
> a given idea ebb and flow over time?", "To what degree do these sets of
> people express a given thing?", or "How often was such and such mentioned?"
> Correct?
>
> If this be the case, then I believe the same research questions can be
> addressed more consistently and at a larger scale if natural langauge
> processing (NLP) methods were applied to the corpus. At the same time, the
> application of NLP ought not be considered a replacement for qualitative
> analsysis tools nor tradidtional reading. Instead, the application of NLP
> ought to be considered a supplemental method of analysis.
>
> --
> Eric Morgan
> Navari Family Center for Digital Scholarship
> University of Notre Dame
>


Re: [CODE4LIB] Qualitative Analysis software and is there a Qualitative Data equivalent to CKAN

2022-09-12 Thread Eric Lease Morgan
On Sep 9, 2022, at 11:25 AM, Kimberli Kelmor 
<00bb820b18d8-dmarc-requ...@lists.clir.org> wrote:

> A while back we kind of talked around qualitative analysis tools. I'd like to 
> query the group about it directly, though.
> 
> What do people use for qualitative data analysis and storage? I've used NVivo 
> before and liked it, but it is pricey and maybe both under and overkill. What 
> else is out there?
> 
> A related question, is there an open data platform that is geared toward 
> qualitative data instead of quantitative data? I'm looking to find something 
> already available that has a strong data/document repository layer, a strong 
> analysis layer, and a strong and flexible presentation or publishing layer.
> 
> Many thanks for any information you can share!
> 
> --
> Kimberli M. Kelmor


Please correct me if I'm wrong. In this case, "qualitative analysis tools" are 
applications where one: 1) assembles a corpus of one or more documents, 2) 
articulates a vocabulary of topics or themes, 3) peruses ("reads") items in the 
corpus assigning vocabulary terms to parts or the whole of the items, and 4) 
does statistical analysis against the assignments. In the end the student, 
researcher, or scholar will address questions such as "How did a given idea ebb 
and flow over time?", "To what degree do these sets of people express a given 
thing?", or "How often was such and such mentioned?" Correct?

If this be the case, then I believe the same research questions can be 
addressed more consistently and at a larger scale if natural langauge 
processing (NLP) methods were applied to the corpus. At the same time, the 
application of NLP ought not be considered a replacement for qualitative 
analsysis tools nor tradidtional reading. Instead, the application of NLP ought 
to be considered a supplemental method of analysis. 

--
Eric Morgan
Navari Family Center for Digital Scholarship
University of Notre Dame


Re: [CODE4LIB] Qualitative Analysis software and is there a Qualitative Data equivalent to CKAN

2022-09-10 Thread Jodi Schneider
My university has a great LibGuide:
https://guides.library.illinois.edu/qualitative

Taguette > is the open source tool I've most often heard mentioned:
https://app.taguette.org
For R folks, RQDA as been around for awhile:
https://rqda.r-forge.r-project.org

A colleague recently tweeted about some of his favorite books:
https://twitter.com/MereSophistry/status/1561416900424392709

I'd love to learn from what others are doing!

-Jodi

On Fri, Sep 9, 2022 at 5:43 PM Barnes, Heather  wrote:

> We use Maxqda, which has both advantages and disadvantages. For coding,
> it’s fairly intuitive, and it does enable mixed methods with its stats add
> on. There is a new Team Cloud feature for collaboration.
>
> On Fri, Sep 9, 2022 at 11:25 AM Kimberli Kelmor <
> 00bb820b18d8-dmarc-requ...@lists.clir.org> wrote:
>
> > Greetings all,
> > A while back we kind of talked around qualitative analysis tools. I'd
> like
> > to query the group about it directly, though.
> >
> > What do people use for qualitative data analysis and storage? I've used
> > NVivo before and liked it, but it is pricey and maybe both under and
> > overkill. What else is out there?
> >
> > A related question, is there an open data platform that is geared toward
> > qualitative data instead of quantitative data? I'm looking to find
> > something already available that has a strong data/document repository
> > layer, a strong analysis layer, and a strong and flexible presentation or
> > publishing layer.
> >
> > Many thanks for any information you can share!
> > Best,
> > Kim
> >
> > Kimberli M. Kelmor | [kmkel...@protonmail.com](https://yahoo.com)
>
> --
> Heather L Barnes
>


Re: [CODE4LIB] Qualitative Analysis software and is there a Qualitative Data equivalent to CKAN

2022-09-09 Thread Barnes, Heather
We use Maxqda, which has both advantages and disadvantages. For coding,
it’s fairly intuitive, and it does enable mixed methods with its stats add
on. There is a new Team Cloud feature for collaboration.

On Fri, Sep 9, 2022 at 11:25 AM Kimberli Kelmor <
00bb820b18d8-dmarc-requ...@lists.clir.org> wrote:

> Greetings all,
> A while back we kind of talked around qualitative analysis tools. I'd like
> to query the group about it directly, though.
>
> What do people use for qualitative data analysis and storage? I've used
> NVivo before and liked it, but it is pricey and maybe both under and
> overkill. What else is out there?
>
> A related question, is there an open data platform that is geared toward
> qualitative data instead of quantitative data? I'm looking to find
> something already available that has a strong data/document repository
> layer, a strong analysis layer, and a strong and flexible presentation or
> publishing layer.
>
> Many thanks for any information you can share!
> Best,
> Kim
>
> Kimberli M. Kelmor | [kmkel...@protonmail.com](https://yahoo.com)

-- 
Heather L Barnes


Re: [CODE4LIB] Qualitative Analysis software and is there a Qualitative Data equivalent to CKAN

2022-09-09 Thread Nick Szydlowski
Hi All,

I would also be really interested in responses to this! I've been working
on a qualitative research project with several collaborators, and we used
Google Drive and Apps Scripts to manage the workflow for coding
interview transcripts. I wouldn't necessarily recommend that approach over
other options, but if anyone is interested the script is here:
https://github.com/NickSzydlowski/qualitative-drive.

All the best,
Nick

On Fri, Sep 9, 2022 at 8:25 AM Kimberli Kelmor <
00bb820b18d8-dmarc-requ...@lists.clir.org> wrote:

> Greetings all,
> A while back we kind of talked around qualitative analysis tools. I'd like
> to query the group about it directly, though.
>
> What do people use for qualitative data analysis and storage? I've used
> NVivo before and liked it, but it is pricey and maybe both under and
> overkill. What else is out there?
>
> A related question, is there an open data platform that is geared toward
> qualitative data instead of quantitative data? I'm looking to find
> something already available that has a strong data/document repository
> layer, a strong analysis layer, and a strong and flexible presentation or
> publishing layer.
>
> Many thanks for any information you can share!
> Best,
> Kim
>
> Kimberli M. Kelmor | [kmkel...@protonmail.com](https://yahoo.com)