Semi-Published Research Data
Semi-Published Research Data
Data sets produced in the course of research and shared between researchers, such as by posting to a website or portal but without preservation capability or commitment. Typically the data remains in the hands of the researchers who have the job of maintaining it. |
||
Digital Species: Research Outputs |
Trend in 2023: No Change |
Consensus Decision |
Added to List: 2019 |
Trend in 2024: No Change |
Previously: Endangered |
Imminence of Action Action is recommended within three years, detailed assessment within one year. |
Significance of Loss The loss of tools, data or services within this group would impact on people and sectors around the world. |
Effort to Preserve It would require a major effort to prevent or reduce losses in this group, possibly requiring the development of new preservation tools or techniques. |
Examples Departmental web servers; project wikis; GitHub repositories. |
||
‘Critically Endangered’ in the Presence of Aggravating Conditions Originating researcher no longer active or changed research focus; staff on temporary contracts; dependence on single student or staff member; weak or fluid institutional commitment to subject matter; weak institutional commitment to data sharing; uncertainty over IPR or the presence of orphaned works; encryption; limited or dysfunctional data management planning; web capture challenges that means unlikely to be picked up by automatic crawlers. |
||
Vulnerable in the Presence of Good Practice Data in preparation for transfer to specialist repository; robust data management planning; documented and managed professionally using data stewards. |
||
2023 Review This 2019 entry was previously introduced in 2017 under ‘Research Data,’ though without explicit reference to semi-published research data. The 2019 Jury split the ‘Research Data’ entry into a range of contexts for research outputs, including this addition. The entry draws attention to represent ‘self-help’ data sharing which is to be encouraged as a means to facilitate open science but should not be confused with long-term preservation. The 2021 Jury agreed with the Endangered classification, noting problems with the volume of data being produced but not being kept in a meaningful way. They noted that research data is complex and has specific requirements for documentation that may only be known to subject matter experts; however, data creators (e.g., researchers) are not necessarily well placed to sustain the data in the long term. There were also a few significant changes to the entry in the 2021 Bit List.
The 2022 Taskforce agreed on a trend towards reduced risk based on material improvement over the last year which had not only offered examples of good research data management and preservation practices but also suggested a significant shift towards a culture of change and collaboration across different research communities and stakeholders. Those mentioned included (but were not limited to) improvements and initiatives by the European Open Science Cloud (EOSC), Science Europe, Research Data Alliance (RDA), Digital Curation Centre (DCC) and related projects on the preservation of research data and outputs. The 2023 Council agreed with the Endangered classification and that risk remained on the same basis as before (‘No change’ to trend). |
||
2024 Interim Review These risks remain on the same basis as before, with no significant trend towards even greater or reduced risk (‘No change’ to trend). |
||
Additional Comments There is a positive trend of increased research data management activity and engagement by libraries and data centres, which should help to ensure that more research datasets are properly deposited in data repositories, rather than left in a 'semi-published' state. Offering and minting researchers Digital Object Identifiers for datasets deposited at specialist repositories will encourage data citation and increase research impact of individual researchers, which traditionally relied more on publishing papers than datasets. See also:
|
Documents, correspondence and other records created in the course of contractual dealings between individuals and agencies, especially where the subjects are of long duration and may be subject to legal scrutiny at undefined points in the distant future. |
||
Digital Species: Formats |
Trend in 2023: No Change |
Consensus Decision |
Added to List: 2017 |
Trend in 2024: No Change |
Previously: Endangered |
Imminence of Action Action is recommended within five years, detailed assessment within three years. |
Significance of Loss The loss of tools or services within this group would have a global impact. |
Effort to Preserve | Inevitability It would require a small effort to preserve materials in this group, requiring the application of proven tools and techniques. |
Examples Gmail, Hotmail, Yahoo Mail, Outlook, and email in all its forms including individual messages, threads of conversation, mailboxes, email servers and file attachments. |
||
‘Critically Endangered’ in the Presence of Aggravating Conditions Lack of skills, commitment or policy from corporate owners; uncertainty or conflicting claims over IPR or orphaned works; use of personal accounts for professional work and vice versa; proliferation and duplication of attachments; email not recognized as a record; absent, unworkable or inconsistent records management; dependence on free cloud-based services; lack of migration path; lack of preservation planning; perverse incentives to delete; encryption. |
||
‘Vulnerable’ in the Presence of Good Practice Application of appraisal and selection tools; timely transfer to preservation facility or archive; commitment to transparency; preservation policy; working preservation plan; clear migration path; widespread recognition of email as a record. |
||
2023 Review This entry was added in 2017, but the Jury did not have the capacity to assess it in detail. It was reviewed and assessed in 2019, including highlights to significant developments, including the recommendations of the Email Preservation Taskforce and the development of the ePADD software. Email presents many preservation challenges, from scale through core technologies, attachments, privacy and intellectual property rights. Because this entry intersects with many others, the aggravating conditions associated with email should be considered in conjunction where relevant. The 2021 Jury agreed with the Endangered classification with an identified trend toward reduced risk. The 2021 trend was based on discussions on continued developments in email preservation tools and techniques, as well as the growing number of archives preserving email content while recognizing issues with providing access to preserved email content. They added that ongoing records management policies towards corporate or business email need to be better embedded to stop the loss of important email content, and more awareness is needed around the potential of personal email. While record-keeping legislation and mandates direct retention periods, email document decisions taken by government officials at local, regional and national levels are not always well maintained, if at all; a loss could impact people’s lives along with their ability to assert rights. The 2022 Taskforce agreed on a trend towards reduced risk based on material improvement with applied examples of good practice, including (but not limited to) approaches to creating a PDF format for the preservation of email, and improvements to existing software, tools and workflows supporting complex email preservation. The 2023 Council agreed with the Endangered classification, with risks remaining on the same basis as before (‘No change’ to the 2023 trend). However, they also noted a decrease in the imminence of action and effort to preserve. The Council also recommended noting areas of overlap with the ‘Cloud-based Services and Communications Platforms’ entry as it pertains to the saving and preservation of email in cloud-based services such as Microsoft Sharepoint. |
||
2024 Interim Review These risks remain on the same basis as before, with no significant trend towards even greater or reduced risk (‘No change’ to trend). They agree with the Endangered classification, with the potential for new initiatives around a profile of PDF specifically for email archiving coming later in 2024, and how this could impact the community. |
||
Additional Comments Email is hugely important as it has been so pervasive as a communication mechanism for society. Some methods used and responsibility adopted for collecting at the business and public body level (again will differ globally), but this will be a fraction of the communities that use it, and few will be set up for the long-term care of this data. Case Studies or Examples:
See also:
|