Archive for the ‘Information Quality Lab news’ Category

Information Quality Lab at the 2024 iSchool Research Showcase

November 6th, 2024

While I’m in Cambridge, today members of my Information Quality Lab present a talk and 9 posters as part of the iSchool Research Showcase 2024, noon to 4:30 PM in the Illini Union. View posters from 12 to 1; during the break between presentation sessions 2-2:45; and 4-4:30 PM.

TALK by Dr. Heng Zheng, based on our forthcoming JCDL 2024 paper:
Addressing Unreliability Propagation in Scientific Digital Libraries
Heng Zheng, Yuanxi Fu, M. Janina Sarol, Ishita Sarraf, Jodi Schneider

POSTERS
Addressing Biomedical Information Overload: Identifying Missing Study Designs to Design Multi-Tagger 2.0
Puranjani Das, Jodi Schneider

Assessing the Quality of Pathotic Arguments
Dexter Williams

Cognitive and Behavioral Approaches to Disinformation Inoculation through a Hidden Object Game
Emily Wegrzyn

Distinguishing Retracted Publications from Retraction Notices in Crossref Data
Luyang Si, Malik Oyewale Salami, Jodi Schneider

Harmonizing Data: Discovering “The Girl From Ipanema”
John Rutherford, Liliana Giusti Serra, Jodi Schneider

“I Lost My Job to AI” — Social Movement Emergence?
Ted Ledford, Jodi Schneider

Recognizing People, Organizations, and Locations Mentioned in the News
Xioran Zhou, Heng Zheng, Jodi Schneider

Representation of Socio-technical Elements in Non-English Audio-visual Media
Puranjani Das, Travis Wagner

What People Say Versus What People Do: Developing a Methodology to Assess Conceptual Heterogeneity in a Scientific Corpus
Yuanxi Fu, Jodi Schneider

Tags: , , , , ,
Posted in Information Quality Lab news | Comments (0)

Graduate hourly-paid job: chemistry expert for a computer information system design project (summer 2024)

June 10th, 2024

Prof. Jodi Schneider’s Information Quality Lab <https://infoqualitylab.org> seeks a paid graduate hourly researcher ($25/hour) to be a chemistry expert for a computer information system design project. Your work will help us understand a computational chemistry protocol by Willoughby, Jansma, and Hoye (2014 Nature Protocols), and the papers citing this protocol. A code glitch impacted part of the Python script for the protocol; our computer information system aims to determine which citing papers might have been impacted by the code glitch, based on reading the papers.

The project can start as soon as possible and needs to be completed in July or early August 2024. We expect your work to take 15 to 20 hours, paid at $25/hour for University of Illinois Urbana-Champaign graduate students. 

Tasks

  • Read and understand a computational chemistry protocol (Willoughby et al. 2014)
  • Read Bhandari Neupane et al. (2019) to understand the nature of the code glitch
  • Make decisions about whether the main findings are at risk for citing publications. You’ll read sentences around citations to ~80 citing publications.
  • Work with an information scientist to design a decision tree to capture the decision-making process.

Required Qualifications

  • Enrolled in a graduate program (Master’s or PhD) in chemistry at University of Illinois Urbana-Champaign and/or background in chemistry sufficient to understand Willoughby et al. (2014) and Bhandari Neupane et al. (2019)
  • Good verbal and written communication skills
  • Interest and/or experience in collaboration

Preferred Qualifications

  • Experience in computational chemistry (quantum chemistry or molecular dynamics) preferred
  • Interest in informatics or computer systems preferred

How to apply

Please email your CV and a few sentences about your interest in the project to Prof. Jodi Schneider (jodi@illinois.edu). Application review will start June 10, 2024 and continue until the position is filled.

Sample citation sentence for Willoughby et al. 2014

“Perhaps one of the most well-known and almost mandatory “to-read” papers for those initial practitioners of the discipline is a 2014 Nature Protocols report by Willoughby, Jansma, and Hoye (WJH).10 In this magnificent piece of work, a detailed 26-step protocol was described, showing how to make the overall NMR calculation procedure up to the final decision on the structure elucidation.”

from: Marcarino, M. O., Zanardi, M. M., & Sarotti, A. M. (2020). The risks of automation: A study on DFT energy miscalculations and its consequences in NMR-based structural elucidation. Organic Letters, 22(9), 3561–3565. https://doi.org/10.1021/acs.orglett.0c01001

Bibliography

Bhandari Neupane, J., Neupane, R. P., Luo, Y., Yoshida, W. Y., Sun, R., & Williams, P. G. (2019). Characterization of Leptazolines A–D, polar oxazolines from the cyanobacterium Leptolyngbya sp., reveals a glitch with the “Willoughby–Hoye” scripts for calculating NMR chemical shifts. Organic Letters, 21(20), 8449–8453. https://doi.org/10.1021/acs.orglett.9b03216

Willoughby, P. H., Jansma, M. J., & Hoye, T. R. (2014). A guide to small-molecule structure assignment through computation of (1H and 13C) NMR chemical shifts. Nature Protocols, 9(3), Article 3. https://doi.org/10.1038/nprot.2014.042

Tags: , ,
Posted in Information Quality Lab news | Comments (0)

Last call for public comments: NISO RP-45-202X, Communication of Retractions, Removals, and Expressions of Concern

November 26th, 2023

I’m pleased that the draft Recommended Practice, NISO RP-45-202X, Communication of Retractions, Removals, and Expressions of Concern (CREC) is open for public comment through December 2, 2023. I’m a member of the NISO Working Group which is funded in part by the Alfred P. Sloan Foundation in collaboration with my Reducing the Inadvertent Spread of Retracted Science project.

The NISO CREC Recommended Practice will address the dissemination of retraction information (metadata & display) to support a consistent, timely transmission of that information to the reader (machine or human), directly or through citing publications, addressing requirements both of the retracted publication and of the retraction notice or expression of concern. It will not address the questions of what a retraction is or why an object is retracted.

NISO CREC

Tags: , , , , ,
Posted in future of publishing, information ecosystem, Information Quality Lab news, library and information science, scholarly communication | Comments (0)

Information Quality Lab at the 2023 iSchool Research Showcase

November 14th, 2023

My Information Quality Lab presents 14 posters as part of the iSchool Research Showcase 2023, Wednesday noon to 4:30 PM in the Illini Union. View posters from 12 to 1; during the break between presentation sessions 2:15-2:45; and 3:30-4:30 PM.

Visualizing Race in Medicine
Chris Wiley

Three-Dimensional Archiving of Native American Artifacts at the Spurlock Museum
David Eby

Harold Baron Digital Archival Research and Publication Project
Divya Pathak

Disinformation Tactics and Designing to Deceive
Emily Wegrzyn

Who Needs a Main Entry, Anyway?
Liliana Giusti Serra, José Fernando Modesto da Silva

Epistemological Responsibility in Law and Science: Sharing the burden
Ted Ledford

How Computable is Scientific Knowledge?
Yuanxi Fu

Unified Framework for Evaluating Confidence in Research Synthesis
Hannah Smith, Yuanxi Fu, Jodi Schneider

Using argument graphs to audit reasoning in empirical scientific publications
Heng Zheng, Yuanxi Fu, Jodi Schneider

Activist Organizations and Their Strategies to Influence the Legalization of Medical Cannabis in Brazil
Janaynne Carvalho do Amaral, Jodi Schneider

Assessing Citation Integrity in Biomedical Publications: Annotation and NLP Models
Janina Sarol, Shufan Ming, Jodi Schneider, Halil Kilicoglu

Can ChatGPT Augment PDF-to-Text Conversion Errors in Scientific Publications?
Janina Sarol, Xuhan Zhang, Tanisha Roman, Jodi Schneider

Analyzing Retraction Indexing Quality in Subject-Specific and Multidisciplinary Databases
Malik Salami, Jodi Schneider

How Knowledge Intermediaries Gather and Make Sense of COVID-19 Information: An Interview Study
Togzhan Seilkhanova, Jodi Schneider

[Updated: 14!]

Tags: , , ,
Posted in Information Quality Lab news | Comments (0)

Medical/Life Sciences Graduate or Undergraduate Student Hourly – Biomedical Literature Annotation for Citation Accuracy/Integrity (10 hours per week, spring semester) – School of Information Sciences – University of Illinois at Urbana-Champaign

January 13th, 2023

The ScienceNLP Lab and the Information Quality Lab at the School of Information Sciences (iSchool) are seeking a University of Illinois at Urbana-Champaign student to read and annotate health-related literature. Knowledge and training and knowledge in a medical/life sciences field such as biology, chemistry, bioinformatics, food science and nutrition, or bioengineering is essential. The hourly will work an average of 10 hours per week for spring semester, under the co-supervision of Dr. Halil Kilicoglu and Dr. Jodi Schneider. The project focuses on assessing biomedical publications for citation accuracy and integrity. Your role in this project will be to locate citation statements in biomedical articles and assess their accuracy with respect to the cited articles. You will collaborate with other annotators on this task. This work is part of the project Natural Language Processing to Assess and Improve Citation Integrity in Biomedical Publications, funded by the Office of Research Integrity (ORI).

Project Description: While citations play a fundamental role in scientific knowledge diffusion and research assessment, they are often inaccurate (e.g., citation of non-existent findings), undermining the integrity of scientific literature and distorting the perception of available evidence. A recent meta-analysis showed that 25.4% of medical articles contained a citation error. A bibliometric analysis revealed that inaccurate citations of a letter published in 1980 may have contributed to the opioid crisis. The project will develop and validate resources and models that aid stakeholders in assessing biomedical publications for citation accuracy and integrity. The publicly available annotated corpus you help create will be used to develop natural language processing/artificial intelligence (NLP/AI) models for assessing reporting quality in biomedical articles.

Duties include:

  • Reading and annotating biomedical publications for citation integrity/accuracy
  • Contribution to development of annotation guidelines
  • Contribution to scientific presentations and publications

Required qualifications:

  • Background in a field such as: medicine, life sciences, including biology, chemistry, bioinformatics, food science and nutrition, bioengineering, or a related field.
  • Excellent English reading comprehension skills
  • Excellent communications skills in written and spoken English
  • Excellent analytical/critical thinking skills
  • Effective time management skills, attention to detail

Preferred qualifications:

  • Interest in topics such as trustworthy science, research rigor/quality, reproducibility
  • Interest in biomedical data science, bioinformatics, or related fields
  • Availability for multiple semesters

Interested candidates should send their CV/resume and a short statement of purpose drawing attention to their training in medicine or life sciences (e.g., biology, chemistry, bioinformatics, food science and nutrition, bioengineering, or a related field) to Halil Kilicoglu (halil@illinois.edu) and Jodi Schneider (jodi@illinois.edu). Review of applications will begin immediately. Applications will be accepted until the position is filled.

Posted on Handshake and the Virtual Job Board.

Tags: , , , , , , , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Graduate Hourly – Annotation (10 hours per week, up to 9 months) – School of Information Sciences – University of Illinois at Urbana-Champaign

June 29th, 2022

The ScienceNLP Lab and the Information Quality Lab at the School of Information Sciences (iSchool) are seeking a University of Illinois at Urbana-Champaign graduate student to read and annotate health-related literature. The graduate hourly will work an average of 10 hours per week for up to 9 months, under the co-supervision of Dr. Halil Kilicoglu and Dr. Jodi Schneider. The project focuses on assessing biomedical publications for citation accuracy and integrity. Your role in this project will be to locate citation statements in biomedical articles and assess their accuracy with respect to the cited articles. You will collaborate with other annotators on this task. This work is part of the project Natural Language Processing to Assess and Improve Citation Integrity in Biomedical Publications, funded by the Office of Research Integrity (ORI).

Project Description: While citations play a fundamental role in scientific knowledge diffusion and research assessment, they are often inaccurate (e.g., citation of non-existent findings), undermining the integrity of scientific literature and distorting the perception of available evidence. A recent meta-analysis showed that 25.4% of medical articles contained a citation error. A bibliometric analysis revealed that inaccurate citations of a letter published in 1980 may have contributed to the opioid crisis. The project will develop and validate resources and models that aid stakeholders in assessing biomedical publications for citation accuracy and integrity. The publicly available annotated corpus you help create will be used to develop natural language processing/artificial intelligence (NLP/AI) models for assessing reporting quality in biomedical articles.

Duties include:

  • Reading and annotating biomedical publications for citation integrity/accuracy
  • Contribution to development of annotation guidelines
  • Contribution to scientific presentations and publications

Required qualifications:

  • Excellent English reading comprehension skills
  • Excellent communications skills in written and spoken English
  • Excellent analytical/critical thinking skills
  • Effective time management skills, attention to detail

Preferred qualifications:

  • Background in a field such as:
    • life sciences/medicine, including biology, chemistry, bioinformatics, foodscience/nutrition, bioengineering, or a related field
    • library/informationsciences
    • linguistics
  • Interest in topics such as trustworthy science, research rigor/quality, reproducibility
  • Interest in biomedical data science, bioinformatics, or related fields
  • Availability for multiple semesters

Interested candidates should send their CV/resume and a short statement of purpose to Halil Kilicoglu (halil@illinois.edu) and Jodi Schneider (jodi@illinois.edu). Review of applications will begin immediately. Applications will be accepted until the position is filled.

Posted on Handshake; note that Halil is also hiring an NLP Research Assistant (50% RA) and an NLP hourly (10 hours per week) for related work on the same project.

Tags: , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Spring 2022 Graduate Research Assistantship 25-50% – Information Quality Lab – University of Illinois at Urbana-Champaign

November 12th, 2021

Start date – January 16, 2022

Description, Responsibilities, & Qualifications:
Mixed methods research assistant to Information Sciences faculty. The incumbent will join the Information Quality Lab under the direction of Dr. Jodi Schneider to work on a newly-funded, three year IMLS grant, Strengthening Public Libraries’ Information Literacy Service Through an Understanding of Knowledge Brokers’ Assessment of Technical and Scientific Information. This project will conduct mixed methods case studies—COVID-19 year 1; climate change (year 2); and AI and labor (year 3)—to understand how knowledge brokers such as journalists, Wikipedia editors, activists/advocates, public librarians assess and use scientific and technical information. Ultimately, the project will develop a conceptual model about sensemaking and use of information. Starting in 2023, the team will co-develop services for knowledge brokers and the public, in collaboration with public library test partners. Results from the project will have implications for public access, information literacy, and understanding of science on policy-relevant topics.

Duties may include:

  • Synthesizing a collection of existing literature related to knowledge brokers.
  • Collecting a sample of about 250 public-facing documents and multimedia, including news (e.g., online print outlets), Wikipedia pages, membership-based online forums, documentaries, and data visualizations, that report, quote, or analyze scientific products (research papers, preprints, datasets, etc.).
  • Using topic modeling, argumentation analysis, and other document analysis techniques to analyze documents and multimedia.
  • Preparing for and conducting interviews with knowledge brokers (journalists, Wikipedia editors, activists/advocates, public librarians).
    • Developing an interview protocol to solicit information from journalists, Wikipedia editors, activists/advocates, public librarians, etc. to understand how they assess the quality of scientific and technical information.
    • Identifying COVID-19 knowledge brokers to interview, by using the document/multimedia collection, organizational directories, etc.
  • Qualitative analysis of interview transcripts (including correcting automatically generated interview transcripts).

Required Qualifications:

  • Excellent communication skills in written and spoken English
  • Excellent analytical/critical thinking skills and effective time management skills
  • Interest in topics such as misinformation, information diffusion, science/technology policy, etc.
  • Interest or experience in one or more methods such as: mixed methods, document analysis, altmetrics, semi-structured interviewing, critical incident technique, or qualitative data analysis

Preferred Qualifications:

  • Available for multiple semesters, including summer
  • Experience conducting and/or transcribing interviews
  • Experience with qualitative analysis software such as ATLAS.TI, NVivo, Taguette, RQDA, etc.
  • Experience as a journalist, Wikipedia editor, activist, advocate, public librarian, information conduit, or knowledge broker
  • Enrollment in the Master’s in Library and Information Science program or in a PhD program
  • Previous completion of one or more CITI Program ethics trainings modules
  • Experience in academic and/or scientific writing

Application Procedure: Interested candidates should send a cover letter and resume in a single pdf file named Lastname_IMLS_RA.pdf (e.g., Schneider_IMLS_RA.pdf) to ischool-infoquality@illinois.edu

Review of applications will begin immediately. Applications will be accepted until the position is filled. All applications received by November 15, 2021 will receive full consideration.

Posted on the Assistantship Clearinghouse.

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Graduate Hourly position – Information Quality Lab – University of Illinois at Urbana-Champaign

November 12th, 2021

Start date – ASAP

Description, Responsibilities, & Qualifications:
Mixed methods research assistant to Information Sciences faculty. The incumbent will join the Information Quality Lab under the direction of Dr. Jodi Schneider to work on a newly-funded, three year IMLS grant, Strengthening Public Libraries’ Information Literacy Service Through an Understanding of Knowledge Brokers’ Assessment of Technical and Scientific Information. This project will conduct mixed methods case studies (first topic: COVID-19) to understand how knowledge brokers such as journalists, Wikipedia editors, activists/advocates, public librarians assess and use scientific and technical information. Ultimately, the project will develop a conceptual model about sensemaking and use of information. Starting in 2023, the team will co-develop services for knowledge brokers and the public, in collaboration with public library test partners. Results from the project will have implications for public access, information literacy, and understanding of science on policy-relevant topics.

This position may become a tuition waiver generating assistantship for the Spring 2022 semester for eligible Master’s and Doctoral students.

Initial duties will include:

  • Developing an interview protocol to solicit information from journalists, Wikipedia editors, activists/advocates, public librarians, etc. to understand how they assess the quality of scientific and technical information
  • Synthesizing a collection of existing literature related to knowledge brokers
  • Collecting a sample of about 250 public-facing documents and multimedia, including news (e.g., online print outlets), Wikipedia pages, membership-based online forums, documentaries, and data visualizations, that report, quote, or analyze scientific products (research papers, preprints, datasets, etc.)
  • Identifying COVID-19 knowledge brokers to interview, by using the document/multimedia collection, organizational directories, etc.

Future work will include:

  • Conducting interviews with knowledge brokers (journalists, Wikipedia editors, activists/advocates, public librarians)
  • Correcting automatically generated interview transcripts
  • Qualitative analysis of interview transcripts
  • Using topic modeling, argumentation analysis, and other document analysis techniques to analyze documents and multimedia
  • Case studies on climate change (year 2) and AI and labor (year 3)

Required Qualifications:

  • Excellent communication skills in written and spoken English
  • Excellent analytical/critical thinking skills and effective time management skills
  • Interest in topics such as: misinformation, information diffusion, science/technology policy
  • Interest or experience in one or more methods such as: mixed methods, document analysis, altmetrics, semi-structured interviewing, critical incident technique, or qualitative data analysis

Preferred Qualifications:

  • Available for multiple semesters, including summer
  • Experience conducting and/or transcribing interviews
  • Experience with qualitative analysis software such as ATLAS.TI, NVivo, Taguette, RQDA, etc.
  • Experience as a journalist, Wikipedia editor, activist, advocate, public librarian, information conduit, or knowledge broker
  • Enrollment in the Master’s in Library and Information Science program or in a PhD program
  • Previous completion of one or more CITI Program ethics trainings modules
  • Experience in academic and/or scientific writing

Compensation: minimum $18/hour for Master’s students or $20/hour for PhD students (negotiable commensurate with experience)

Application Procedure: Interested candidates should send a cover letter and resume in a single PDF file named Lastname_IMLS_hourly.pdf (e.g., Schneider_IMLS_hourly.pdf) to ischool-infoquality@illinois.edu.

Review of applications will begin immediately. Applications will be accepted until the position is filled. All applications received by November 15, 2021 will receive full consideration.

Posted on the University of Illinois Financial Aid Virtual Job Board and Handshake.

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)