Archive for the ‘Information Quality Lab news’ Category

Last call for public comments: NISO RP-45-202X, Communication of Retractions, Removals, and Expressions of Concern

November 26th, 2023

I’m pleased that the draft Recommended Practice, NISO RP-45-202X, Communication of Retractions, Removals, and Expressions of Concern (CREC) is open for public comment through December 2, 2023. I’m a member of the NISO Working Group which is funded in part by the Alfred P. Sloan Foundation in collaboration with my Reducing the Inadvertent Spread of Retracted Science project.

The NISO CREC Recommended Practice will address the dissemination of retraction information (metadata & display) to support a consistent, timely transmission of that information to the reader (machine or human), directly or through citing publications, addressing requirements both of the retracted publication and of the retraction notice or expression of concern. It will not address the questions of what a retraction is or why an object is retracted.

NISO CREC

Tags: , , , , ,
Posted in future of publishing, information ecosystem, Information Quality Lab news, library and information science, scholarly communication | Comments (0)

Information Quality Lab at the 2023 iSchool Research Showcase

November 14th, 2023

My Information Quality Lab presents 14 posters as part of the iSchool Research Showcase 2023, Wednesday noon to 4:30 PM in the Illini Union. View posters from 12 to 1; during the break between presentation sessions 2:15-2:45; and 3:30-4:30 PM.

Visualizing Race in Medicine
Chris Wiley

Three-Dimensional Archiving of Native American Artifacts at the Spurlock Museum
David Eby

Harold Baron Digital Archival Research and Publication Project
Divya Pathak

Disinformation Tactics and Designing to Deceive
Emily Wegrzyn

Who Needs a Main Entry, Anyway?
Liliana Giusti Serra, José Fernando Modesto da Silva

Epistemological Responsibility in Law and Science: Sharing the burden
Ted Ledford

How Computable is Scientific Knowledge?
Yuanxi Fu

Unified Framework for Evaluating Confidence in Research Synthesis
Hannah Smith, Yuanxi Fu, Jodi Schneider

Using argument graphs to audit reasoning in empirical scientific publications
Heng Zheng, Yuanxi Fu, Jodi Schneider

Activist Organizations and Their Strategies to Influence the Legalization of Medical Cannabis in Brazil
Janaynne Carvalho do Amaral, Jodi Schneider

Assessing Citation Integrity in Biomedical Publications: Annotation and NLP Models
Janina Sarol, Shufan Ming, Jodi Schneider, Halil Kilicoglu

Can ChatGPT Augment PDF-to-Text Conversion Errors in Scientific Publications?
Janina Sarol, Xuhan Zhang, Tanisha Roman, Jodi Schneider

Analyzing Retraction Indexing Quality in Subject-Specific and Multidisciplinary Databases
Malik Salami, Jodi Schneider

How Knowledge Intermediaries Gather and Make Sense of COVID-19 Information: An Interview Study
Togzhan Seilkhanova, Jodi Schneider

[Updated: 14!]

Tags: , , ,
Posted in Information Quality Lab news | Comments (0)

Medical/Life Sciences Graduate or Undergraduate Student Hourly – Biomedical Literature Annotation for Citation Accuracy/Integrity (10 hours per week, spring semester) – School of Information Sciences – University of Illinois at Urbana-Champaign

January 13th, 2023

The ScienceNLP Lab and the Information Quality Lab at the School of Information Sciences (iSchool) are seeking a University of Illinois at Urbana-Champaign student to read and annotate health-related literature. Knowledge and training and knowledge in a medical/life sciences field such as biology, chemistry, bioinformatics, food science and nutrition, or bioengineering is essential. The hourly will work an average of 10 hours per week for spring semester, under the co-supervision of Dr. Halil Kilicoglu and Dr. Jodi Schneider. The project focuses on assessing biomedical publications for citation accuracy and integrity. Your role in this project will be to locate citation statements in biomedical articles and assess their accuracy with respect to the cited articles. You will collaborate with other annotators on this task. This work is part of the project Natural Language Processing to Assess and Improve Citation Integrity in Biomedical Publications, funded by the Office of Research Integrity (ORI).

Project Description: While citations play a fundamental role in scientific knowledge diffusion and research assessment, they are often inaccurate (e.g., citation of non-existent findings), undermining the integrity of scientific literature and distorting the perception of available evidence. A recent meta-analysis showed that 25.4% of medical articles contained a citation error. A bibliometric analysis revealed that inaccurate citations of a letter published in 1980 may have contributed to the opioid crisis. The project will develop and validate resources and models that aid stakeholders in assessing biomedical publications for citation accuracy and integrity. The publicly available annotated corpus you help create will be used to develop natural language processing/artificial intelligence (NLP/AI) models for assessing reporting quality in biomedical articles.

Duties include:

  • Reading and annotating biomedical publications for citation integrity/accuracy
  • Contribution to development of annotation guidelines
  • Contribution to scientific presentations and publications

Required qualifications:

  • Background in a field such as: medicine, life sciences, including biology, chemistry, bioinformatics, food science and nutrition, bioengineering, or a related field.
  • Excellent English reading comprehension skills
  • Excellent communications skills in written and spoken English
  • Excellent analytical/critical thinking skills
  • Effective time management skills, attention to detail

Preferred qualifications:

  • Interest in topics such as trustworthy science, research rigor/quality, reproducibility
  • Interest in biomedical data science, bioinformatics, or related fields
  • Availability for multiple semesters

Interested candidates should send their CV/resume and a short statement of purpose drawing attention to their training in medicine or life sciences (e.g., biology, chemistry, bioinformatics, food science and nutrition, bioengineering, or a related field) to Halil Kilicoglu (halil@illinois.edu) and Jodi Schneider (jodi@illinois.edu). Review of applications will begin immediately. Applications will be accepted until the position is filled.

Posted on Handshake and the Virtual Job Board.

Tags: , , , , , , , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Graduate Hourly – Annotation (10 hours per week, up to 9 months) – School of Information Sciences – University of Illinois at Urbana-Champaign

June 29th, 2022

The ScienceNLP Lab and the Information Quality Lab at the School of Information Sciences (iSchool) are seeking a University of Illinois at Urbana-Champaign graduate student to read and annotate health-related literature. The graduate hourly will work an average of 10 hours per week for up to 9 months, under the co-supervision of Dr. Halil Kilicoglu and Dr. Jodi Schneider. The project focuses on assessing biomedical publications for citation accuracy and integrity. Your role in this project will be to locate citation statements in biomedical articles and assess their accuracy with respect to the cited articles. You will collaborate with other annotators on this task. This work is part of the project Natural Language Processing to Assess and Improve Citation Integrity in Biomedical Publications, funded by the Office of Research Integrity (ORI).

Project Description: While citations play a fundamental role in scientific knowledge diffusion and research assessment, they are often inaccurate (e.g., citation of non-existent findings), undermining the integrity of scientific literature and distorting the perception of available evidence. A recent meta-analysis showed that 25.4% of medical articles contained a citation error. A bibliometric analysis revealed that inaccurate citations of a letter published in 1980 may have contributed to the opioid crisis. The project will develop and validate resources and models that aid stakeholders in assessing biomedical publications for citation accuracy and integrity. The publicly available annotated corpus you help create will be used to develop natural language processing/artificial intelligence (NLP/AI) models for assessing reporting quality in biomedical articles.

Duties include:

  • Reading and annotating biomedical publications for citation integrity/accuracy
  • Contribution to development of annotation guidelines
  • Contribution to scientific presentations and publications

Required qualifications:

  • Excellent English reading comprehension skills
  • Excellent communications skills in written and spoken English
  • Excellent analytical/critical thinking skills
  • Effective time management skills, attention to detail

Preferred qualifications:

  • Background in a field such as:
    • life sciences/medicine, including biology, chemistry, bioinformatics, foodscience/nutrition, bioengineering, or a related field
    • library/informationsciences
    • linguistics
  • Interest in topics such as trustworthy science, research rigor/quality, reproducibility
  • Interest in biomedical data science, bioinformatics, or related fields
  • Availability for multiple semesters

Interested candidates should send their CV/resume and a short statement of purpose to Halil Kilicoglu (halil@illinois.edu) and Jodi Schneider (jodi@illinois.edu). Review of applications will begin immediately. Applications will be accepted until the position is filled.

Posted on Handshake; note that Halil is also hiring an NLP Research Assistant (50% RA) and an NLP hourly (10 hours per week) for related work on the same project.

Tags: , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Spring 2022 Graduate Research Assistantship 25-50% – Information Quality Lab – University of Illinois at Urbana-Champaign

November 12th, 2021

Start date – January 16, 2022

Description, Responsibilities, & Qualifications:
Mixed methods research assistant to Information Sciences faculty. The incumbent will join the Information Quality Lab under the direction of Dr. Jodi Schneider to work on a newly-funded, three year IMLS grant, Strengthening Public Libraries’ Information Literacy Service Through an Understanding of Knowledge Brokers’ Assessment of Technical and Scientific Information. This project will conduct mixed methods case studies—COVID-19 year 1; climate change (year 2); and AI and labor (year 3)—to understand how knowledge brokers such as journalists, Wikipedia editors, activists/advocates, public librarians assess and use scientific and technical information. Ultimately, the project will develop a conceptual model about sensemaking and use of information. Starting in 2023, the team will co-develop services for knowledge brokers and the public, in collaboration with public library test partners. Results from the project will have implications for public access, information literacy, and understanding of science on policy-relevant topics.

Duties may include:

  • Synthesizing a collection of existing literature related to knowledge brokers.
  • Collecting a sample of about 250 public-facing documents and multimedia, including news (e.g., online print outlets), Wikipedia pages, membership-based online forums, documentaries, and data visualizations, that report, quote, or analyze scientific products (research papers, preprints, datasets, etc.).
  • Using topic modeling, argumentation analysis, and other document analysis techniques to analyze documents and multimedia.
  • Preparing for and conducting interviews with knowledge brokers (journalists, Wikipedia editors, activists/advocates, public librarians).
    • Developing an interview protocol to solicit information from journalists, Wikipedia editors, activists/advocates, public librarians, etc. to understand how they assess the quality of scientific and technical information.
    • Identifying COVID-19 knowledge brokers to interview, by using the document/multimedia collection, organizational directories, etc.
  • Qualitative analysis of interview transcripts (including correcting automatically generated interview transcripts).

Required Qualifications:

  • Excellent communication skills in written and spoken English
  • Excellent analytical/critical thinking skills and effective time management skills
  • Interest in topics such as misinformation, information diffusion, science/technology policy, etc.
  • Interest or experience in one or more methods such as: mixed methods, document analysis, altmetrics, semi-structured interviewing, critical incident technique, or qualitative data analysis

Preferred Qualifications:

  • Available for multiple semesters, including summer
  • Experience conducting and/or transcribing interviews
  • Experience with qualitative analysis software such as ATLAS.TI, NVivo, Taguette, RQDA, etc.
  • Experience as a journalist, Wikipedia editor, activist, advocate, public librarian, information conduit, or knowledge broker
  • Enrollment in the Master’s in Library and Information Science program or in a PhD program
  • Previous completion of one or more CITI Program ethics trainings modules
  • Experience in academic and/or scientific writing

Application Procedure: Interested candidates should send a cover letter and resume in a single pdf file named Lastname_IMLS_RA.pdf (e.g., Schneider_IMLS_RA.pdf) to ischool-infoquality@illinois.edu

Review of applications will begin immediately. Applications will be accepted until the position is filled. All applications received by November 15, 2021 will receive full consideration.

Posted on the Assistantship Clearinghouse.

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Graduate Hourly position – Information Quality Lab – University of Illinois at Urbana-Champaign

November 12th, 2021

Start date – ASAP

Description, Responsibilities, & Qualifications:
Mixed methods research assistant to Information Sciences faculty. The incumbent will join the Information Quality Lab under the direction of Dr. Jodi Schneider to work on a newly-funded, three year IMLS grant, Strengthening Public Libraries’ Information Literacy Service Through an Understanding of Knowledge Brokers’ Assessment of Technical and Scientific Information. This project will conduct mixed methods case studies (first topic: COVID-19) to understand how knowledge brokers such as journalists, Wikipedia editors, activists/advocates, public librarians assess and use scientific and technical information. Ultimately, the project will develop a conceptual model about sensemaking and use of information. Starting in 2023, the team will co-develop services for knowledge brokers and the public, in collaboration with public library test partners. Results from the project will have implications for public access, information literacy, and understanding of science on policy-relevant topics.

This position may become a tuition waiver generating assistantship for the Spring 2022 semester for eligible Master’s and Doctoral students.

Initial duties will include:

  • Developing an interview protocol to solicit information from journalists, Wikipedia editors, activists/advocates, public librarians, etc. to understand how they assess the quality of scientific and technical information
  • Synthesizing a collection of existing literature related to knowledge brokers
  • Collecting a sample of about 250 public-facing documents and multimedia, including news (e.g., online print outlets), Wikipedia pages, membership-based online forums, documentaries, and data visualizations, that report, quote, or analyze scientific products (research papers, preprints, datasets, etc.)
  • Identifying COVID-19 knowledge brokers to interview, by using the document/multimedia collection, organizational directories, etc.

Future work will include:

  • Conducting interviews with knowledge brokers (journalists, Wikipedia editors, activists/advocates, public librarians)
  • Correcting automatically generated interview transcripts
  • Qualitative analysis of interview transcripts
  • Using topic modeling, argumentation analysis, and other document analysis techniques to analyze documents and multimedia
  • Case studies on climate change (year 2) and AI and labor (year 3)

Required Qualifications:

  • Excellent communication skills in written and spoken English
  • Excellent analytical/critical thinking skills and effective time management skills
  • Interest in topics such as: misinformation, information diffusion, science/technology policy
  • Interest or experience in one or more methods such as: mixed methods, document analysis, altmetrics, semi-structured interviewing, critical incident technique, or qualitative data analysis

Preferred Qualifications:

  • Available for multiple semesters, including summer
  • Experience conducting and/or transcribing interviews
  • Experience with qualitative analysis software such as ATLAS.TI, NVivo, Taguette, RQDA, etc.
  • Experience as a journalist, Wikipedia editor, activist, advocate, public librarian, information conduit, or knowledge broker
  • Enrollment in the Master’s in Library and Information Science program or in a PhD program
  • Previous completion of one or more CITI Program ethics trainings modules
  • Experience in academic and/or scientific writing

Compensation: minimum $18/hour for Master’s students or $20/hour for PhD students (negotiable commensurate with experience)

Application Procedure: Interested candidates should send a cover letter and resume in a single PDF file named Lastname_IMLS_hourly.pdf (e.g., Schneider_IMLS_hourly.pdf) to ischool-infoquality@illinois.edu.

Review of applications will begin immediately. Applications will be accepted until the position is filled. All applications received by November 15, 2021 will receive full consideration.

Posted on the University of Illinois Financial Aid Virtual Job Board and Handshake.

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Information Quality Lab news | Comments (0)

Fully funded PhD program in Information Sciences, University of Illinois at Urbana-Champaign, deadline December 1, 2021

November 2nd, 2021

Dr. Jodi Schneider’s Information Quality Lab invites applications for fully funded PhD students in Information Sciences at the School of Information Sciences (iSchool), University of Illinois at Urbana-Champaign.

Current areas of interest include:

  • scientific information and how it is used by researchers and the public
  • scholarly communication
  • controversies within science
  • potential sources of bias in scientific research
  • confidence in applying science to public policy

Candidates should have a Bachelor’s or Master’s degree in any field (e.g., mathematics, sciences, information sciences, philosophy, liberal arts, etc.). The most essential skills are strong critical thinking and excellent written and spoken English. Interest or experience in research, academic writing, and interdisciplinary inquiry are strongly preferred.

Students in the Information Quality Lab develop both domain expertise and technical skills. Examples of relevant domains include public policy, public health, libraries, journalism, publishing, citizen science, information services, and life sciences research. Examples of technical skills include knowledge representation, text and data analytics, news analytics, argumentation analysis, document analysis, qualitative analysis, user-centered design, and mixed methods.

Examples of current Information Quality Lab projects:
REDUCING THE INADVERTENT SPREAD OF RETRACTED SCIENCE: SHAPING A RESEARCH AND IMPLEMENTATION AGENDA (Alfred P. Sloan Foundation) – stakeholder-engaged research to understand the continued citation of retracted research, currently focusing on standards development and raising awareness of what various stakeholders across scholarly communication can do.

STRENGTHENING PUBLIC LIBRARIES’ INFORMATION LITERACY SERVICES THROUGH AN UNDERSTANDING OF KNOWLEDGE BROKERS’ ASSESSMENT OF TECHNICAL AND SCIENTIFIC INFORMATION (Institute of Museum and Library Services Early Career Development) – Scientific misinformation and pseudoscience have a significant impact on public deliberation. This project will conduct case studies on COVID-19, climate change, and artificial intelligence to understand how journalists, Wikipedia editors, activists, and public librarians broker knowledge to the public. We will develop actionable strategies for reducing public misinformation about scientific and technical information.

USING NETWORK ANALYSIS TO SUPPORT AND ASSESS CONFIDENCE IN RESEARCH SYNTHESIS (National Science Foundation CAREER) – developing and testing a novel framework to evaluate sets of expert literature for potential sources of bias and to allow evidence-seekers to swiftly determine the level of consensus within a body of literature and identify the risk factors which could impact the reliability of the research.

Dr. Jodi Schneider studies the science of science through the lens of arguments, evidence, and persuasion. She seeks to advance our understanding of scientific communication in order to develop tools and strategies to manage information overload in science, using mixed methods including semantic web technology (metadata/ontologies/etc.), network analysis, text mining and user-centered design. Her long-term research agenda analyzes controversies applying science to public policy; how knowledge brokers influence citizens; and whether controversies are sustained by citizens’ disparate interpretations of scientific evidence and its quality. Prior to joining the iSchool, Schneider served as a postdoctoral scholar at the National Library of Medicine, the University of Pittsburgh Department of Biomedical Informatics, and INRIA, the national French Computer Science Research Institute. She is an NSF CAREER awardee and holds an Institute of Museum and Library Services Early Career Development grant. Her past projects have been funded by the Alfred P. Sloan Foundation, the National Institutes of Health, Science Foundation Ireland, and the European Commission.

iSchool PhD PROGRAM
iSchool PhD students have backgrounds in a broad range of fields, including the social sciences, sciences, arts, humanities, computing, and artificial intelligence. Accepted students are guaranteed five years of funding in the form of research and teaching assistantships, which include tuition waivers and a stipend. Additional funding is available for conference travel.

Our PhD program in Information Science is the oldest existing LIS doctoral program in the U.S. with 270 graduates. Recent graduates are now faculty members at institutions such as the University of Michigan, University of Washington, University of Maryland, Drexel, and UCLA, professionals at Baidu, Google, Twitter, Uber and AbbVie, and academic library professionals at the Library of Congress, Princeton University, and the University of Chicago.

APPLICATION PROCESS
For more information about the application process, please visit: https://ischool.illinois.edu/degrees-programs/phd-information-sciences/apply
Next application deadline: December 1, 2021
(This is an annual opportunity.)

QUESTIONS

For additional information about the iSchool PhD program, see https://ischool.illinois.edu/degrees-programs/phd-information-sciences

For questions about the program, please contact Prof. Michael Twidale, PhD Program Director, at ischool-phd@illinois.edu.

For questions, about the Information Quality Lab, please contact Dr. Jodi Schneider.

Tags: , , ,
Posted in higher education, Information Quality Lab news, library and information science | Comments (0)

Paid hourly student research programmer position at UIUC for Fall 2021: network visualization in Python with NetworkX

September 11th, 2021

My Information Quality Lab is seeking a student research programmer (graduate hourly/undergraduate hourly) to do network visualization in Python with NetworkX this semester.

REQUIRED background:

  • Programming experience in Python
  • Elementary knowledge about network analysis including nodes, edges, attribute list, edge list, and adjacency matrices
  • How to read, store, and retrieve network data from a network object
  • Interest in or experience with NetworkX
  • Interest in or experience with visualization

PREFERRED background:

  • Experience in a research or R&D environment
  • Familiarity with publication and citation data

The immediate goal is to reformat dynamic network visualizations in a conference paper for a journal article to be submitted this semester (publication credit possible in addition to pay). Data for this is publicly available: https://doi.org/10.13012/B2IDB-9222782_V1
A conference paper describes the underlying ideas http://jodischneider.com/pubs/asist2020.pdf

This person will also develop utilities to be used in future network visualizations (e.g. an ongoing analysis of a similar but larger network where other aspects, e.g. co-authorship and data cleaning, will also be relevant).

Application details in Virtual Job Board

Tags: , ,
Posted in Information Quality Lab news | Comments (0)