# Reindexing a large number of records in the REST API

**URL:** <https://community.crossref.org/t/reindexing-a-large-number-of-records-in-the-rest-api/2568>\
**Category:** Metadata Retrieval\
**Tags:** rest-api, metadata\
**Created:** [23 March 2022 21:07 UTC](https://community.crossref.org/t/reindexing-a-large-number-of-records-in-the-rest-api/2568 "2022-03-23T21:07:18Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ppolischuk](https://avatars.discourse-cdn.com/v4/letter/p/9dc877/32.png) [@ppolischuk](https://community.crossref.org/u/ppolischuk)\
**Post date:** [23 March 2022 21:07 UTC](https://community.crossref.org/t/reindexing-a-large-number-of-records-in-the-rest-api/2568/1 "2022-03-23T21:07:18Z")

</div>

We recently completed development on some fixes and feature enhancements to the Crossref REST API. Soon, [special characters will no longer be removed from DOIs during ingestion to the REST API](https://gitlab.com/crossref/issues/-/issues/1533), [markup will be retained in titles](https://gitlab.com/crossref/issues/-/issues/1001), and [resource URLs will be included in the JSON response](https://gitlab.com/crossref/issues/-/issues/1608).

In order to realize these changes across those records affected by these improvements, we will be scanning for and reindexing affected DOIs. We generally recommend you use the indexed date to retrieve periodic, incremental metadata updates. If you do, you will notice an increased number of reindexed records over the next few weeks.

Please reply here or contact us at [support@crossref.org](mailto:support@crossref.org) with any questions.

---

<div class="post-metadata">

**Author:** ![ppolischuk](https://avatars.discourse-cdn.com/v4/letter/p/9dc877/32.png) [@ppolischuk](https://community.crossref.org/u/ppolischuk)\
**Post date:** [5 May 2022 20:20 UTC](https://community.crossref.org/t/reindexing-a-large-number-of-records-in-the-rest-api/2568/2 "2022-05-05T20:20:48Z")

</div>

As part of the work to no longer remove certain characters from DOIs during REST API ingestion, we reindexed those records so that all characters were retained in DOIs. We also removed the incorrect DOIs from our index.

If you need a mapping of new and removed DOIs, we’ve put together a mapping file: [modified\_dois.csv](https://community.crossref.org/uploads/short-url/icuBnAZgyBi0m81sPyHYVQGdalL.csv) (6.3 KB)

Please see the below Gitlab issue for details.

> **[Cayenne should not remove characters from DOIs during ingestion (#1533) ·...](https://gitlab.com/crossref/issues/-/issues/1533)**
>
> Background Cayenne removes some characters, including non-printable and unicode characters, from DOI while ingesting. This happens when XML is transformed into...