Before using the filters or the alphabetical list of elements that you could address in a CV, read the information under the arrows as well. The information not only addresses your own responsibilities and points to the research information system (Pure) as a valuable source for indicators, but also lists what you can do with the information gathered on research outputs and activities. It also addresses some other characteristics – next to quantitative indicators – that might make them ‘special’.

Which indicators to address in an assessment context

Which indicators to use and which aspects of your academic profile to highlight depends on the assessment context, your discipline (typical outputs and activities), your personal situation, or on the specifics of the research project for which a grant is applied. Although we consider all the indicators in this overview responsible, narrative CVs can differ in the indicators that are allowed. You have to pay close attention to these restrictions, and it is the sole responsibility of the scholar that the indicators used match with the requirements for a specific type of narrative CV.

Number of citations, views, downloads, mentions, etc. (raw counts)

For many research outputs, only ‘usage’ indicators are available such as the numbers of citations, mentions, views, downloads, or holdings (for books). When using these raw counts keep in mind that they are difficult to interpret when a benchmark is missing to which one can compare these numbers. Such benchmarks only exists for publications indexed in the Web of Science or Scopus

Further guidance on benchmarks

Guidance on how to use raw counts; Pitfalls when looking for indicators – Using raw counts (citations, mentions, views etc.)

For indicators better not to use and the reasons why; Research Intelligence Services – Responsible metrics

For the drawbacks and reasons why views and downloads are introduced as indicators of (potential) impact, see: Views and downloads (a special brand of altmetrics) and their drawbacks

A lot of research output or research results, like methods, procedures, processes, tests, probes, reagents, instruments, designs, datasets and research software, are still not often explicitly referenced in publications.

When only mentioned in the text, it is difficult to collect usage data like citations. The same applies to the use of research infrastructures, databases or research facilities. You may personally know some users, but when you want to get a more complete view on this use you need to search by a name, a concept or description in the full-text. However, these searches are only feasible when you have a good idea or reasonable suspicion which full-text documents to search.

The academic profile as the foundation for indicators: UM’s Current Research Information System (CRIS) is Pure

Main advantages
The main advantage of using Pure to register your accomplishments – from an assessment perspective – is that you can refer others to it without addressing individual entries. The Pure portal not only shows the kind and number of objects and activities registered under your name but also information on:

  • the intended public of an item (academic / professional / popular)
  • with whom you collaborate (internal and external)
  • the status of a publication (refereed/non-refereed, OA/not OA)
  • the number of times a publication has been cited in the Web of Science, or downloaded from Pure, and
  • if a research output has generated online attention which can be further investigated through the Altmetric and PlumX links presented next to an output.

This additional information enables others to get a much quicker and more complete view of your academic profile, provided that Pure is fully used.

For academics themselves, the additional information in Pure enables you to look for publications with citations, downloads, or media attention that could be worthwhile to investigate further. Publications with high numbers of citations or attention do not necessarily reflect main or most important contributions. However, the (kind of) sources, channels, institutes and people behind these numbers might provide additional context for a publication or to show how your research has been picked up in the academic realm or by other societal stakeholders or target groups.

Another advantage of Pure is that entries are validated by third persons (faculty Pure key-users) making Pure a ‘trusted’ source, and last but not least that it offers opportunities to register many research related activities as well.

Activities in Pure
Besides research outputs, awards, prizes, etc., Pure also offers opportunities to register research related activities, which are becoming more important in assessment contexts.
The following sub-categories are available as part of ‘activities’ in Pure:

  • Talk or presentation – at conference
  • Editorial activity, journal
  • Organizing or contriuting to an event
  • Peer review (publication)
  • PhD (co-)supervision / assessment committee – internal promotion
  • Membership of committee
  • Consultancy / Advise external parties
  • Membership of network
  • Membership of board
  • External collaboration in research projects
  • Membership of council
  • Editorial activity, book
  • Attending an event
  • Teaching to External parties / At external institution
  • Performance, Talk or Presentation – not at conference
  • Inaugural speech
  • Farewell speech
  • PhD assessment committee – external promotion
  • PhD (co-)supervision – external promotion
  • Advise to PR / Marketing internal

More information on Pure: https://library.maastrichtuniversity.nl/pure-support/

 

What to do with the information gathered on research outputs from Pure and other sources

Besides specifying the number and kind of citations, mentions, views and downloads of your published research, you can specify many other characteristics of your research output like the ones listed below. The ‘Specifies’ in the list do not mean that you have to address them all. They are examples of what you could specify. Which indicators and characteristics to use and which aspects of your academic profile to highlight, depends on the assessment context, your discipline (typical outputs and activities), your personal situation, or the specifics of the research project for which a grant is applied.

However, in many narrative CVs it is mandatory to specify the PIDs and the openness or the OA status of your research output(s), while the others have a more non-binding character.

Keep in mind that besides review activities, other activities registered in the research information system Pure can also indicate important aspects of your Academic Citizenship.

Identify ‘special’ research outputs or activities

Research outputs can be ‘special’ for many reasons. For example, many other researchers or institutes are using your research software, instruments, tests or methods. The alignment of your research outputs or activities to societal needs might be another reason. The reuse of data and research software from others can also be worth mentioning, or the publication was the result of a replication study or a study to reproduce research results. Outputs that should be recognised and rewarded on an equal footing as innovative or impactful research under the Hong Kong Principles (HKPs).

Other outputs recognised under the Hong Kong principles are reviews and systematic reviews because they synthesise existing research or research that reports negative results and that takes more effort to get published. In line with the Hong Kong principles, you could also specify if the research was pre-registered* or if reporting guidelines are used to increase the transparency and reproducibility of your research. Important values in the transition to Open Science and under the HKPs, as well as the use of data-management plans, and all the efforts to make data and research software as open as possible.

(* Preregistration has also become an important element in UM’s Open Science policy: Policy “Open Science @ UM” 2022-2026)

When addressing educational outputs like textbooks, presentations, etc. developed for your own institution or external third parties, also mention the efforts to enhance the accessibility of the outputs – not only for vision-impaired students, but also for students tired of screen reading or watching videos in crowded situations. Enhancing the accessibility makes it more inclusive.[1]

[1] See: https://library.maastrichtuniversity.nl/visit/facilities-studyplaces/facilities-for-disabled/#Tips_for_creating_accessible_course_material

Citations & mentions of special interest and their sources (summary)

Find a summary under this link:
Citations / mentions of special interest (book, chapters, articles and datasets) – Summary

Start collecting indicators and characteristics for your narrative

​The alphabetical list below contains information cards on how to collect evidence for the use of common research outputs and by whom. The ‘Specify …’-cards describe what you can do with the information gathered. Each card contains links to other guidance (i.e. more in-depth explanations or background information), or to how to use tools and sources (in writing or video), as do the ‘How to obtain…‘-cards in the list.

When filtered, only information cards are shown for the chosen output/activity or those that are relevant in combination with a chosen type of impact representing assessment components from the UM Career Compass. However, using filters does not prevent many recurring cards, but we hope it will make navigating a little easier.