From Collection to Discovery: Why Processing Takes Time

If you mailed us a little microSD card for Eclipse Soundscapes, you might be wondering: what happened after it left your hands? Why did processing take over a year? The short answer: scale and complexity.

Think about it.

• Nearly 1,000 AudioMoth devices were registered across both eclipses (219 in 2023 and 770 in 2024).
• Over 600 microSD cards were mailed back (126 in 2023 and 477 in 2024), each with hours of audio.
• Two eclipses happened only about six months apart, which meant we were still receiving and logging 2023 data while also updating protocols, training new volunteers, and preparing free kits for 2024.
• Some cards came with carefully written notes about time and location, while others had only online notes, only handwritten notes, both, or none at all. That mix made every envelope a surprise, sometimes a complete package and sometimes a puzzle to solve.

When plans met reality

In 2023, things were fairly straightforward on paper. We had not yet invited people to use their own devices, so most returns came in the standardized envelopes we provided, each clearly marked with an ES ID. Even so, sorting took longer than expected. We had originally planned for about 50 sites in 2023 and 200 in 2024, but so many people were excited to join that we expanded both years. That surge meant every microSD card had to be carefully logged by hand, checking whether we had the card itself, the online location info, and any written notes. We worked hard to be transparent by releasing several shared “data dashboard” spreadsheets on the website and posting social media reminders to check them. These updates let participants know what we had on file for them, but the process was still manual work, card by card.

By 2024, when volunteers were invited to purchase and use their own AudioMoths, participation grew even bigger and the returns became more varied. Instead of neat, uniform envelopes, we began receiving packages of all shapes and sizes, many without an ES ID on the outside. Matching each one to online or handwritten notes added another layer of complexity and time.

Device prep behind the scenes

For the 2023 annular eclipse, we prepped and mailed 219 kits before the event (64 for ES partners and team, 155 free kits). These devices were shipped with batteries uninstalled, which meant participants had to set the device’s internal clock themselves. That turned out to be more complicated than expected and also revealed that some AudioMoths might malfunction.

Between 2023 and 2024, we ran battery usage tests to see if we could set the clocks and install batteries before mailing and still have enough battery power left by eclipse day. The answer was yes. That change made things easier for volunteers in 2024, but it also added more work for the ES team. While we were still receiving and processing 2023 data, we were preparing and mailing 390 additional free kits for 2024. Each device had its time manually set before mailing, in addition to batteries installed.

One thing remained consistent in both years: every AudioMoth required a firmware update, which had to be performed one by one by connecting the device to a computer. We also logged each device’s serial number, manually assigned an ES ID, and labeled the device in both written and braille formats.

Beyond the devices themselves, we also provided everything a Data Collector might need, so it was as easy as possible to focus on the science of data collection. Each kit was assembled by hand with return labels, bags, and zip ties, and packaged one by one. This careful preparation was time-consuming but essential for keeping everything organized and supporting volunteers.

Two eclipses, back to back

It was incredibly exciting that the 2023 annular and 2024 total eclipses happened so close together. The 2023 eclipse gave us the chance to test our protocols for the first time, then immediately improve them for 2024. But it also meant the timelines overlapped. While we were still receiving and logging annular data, we were also reviewing what went well for Apprentices, Observers, and Data Collectors in 2023, updating trainings, preparing free kits, and making improvements for the total eclipse. The quick turnaround left us with some catching up to do once the 2024 data began arriving.

Training improvements took time

After the 2023 annular eclipse, we carefully reviewed what went right and what could be better across all three roles: Apprentice, Observer, and Data Collector. That review directly shaped some big changes for 2024. In addition to having complete instructions on the website, we added more live Q and A sessions, more live trainings, and quick tips that went out weekly in the days and weeks before the total eclipse. These changes helped Data Collectors feel supported and prepared (and also improved training for ES Observers), but the careful review and the work to build new materials also took time.

We began receiving cards in October 2023, with huge influxes in the two months after the 2023 annular eclipse and again after the 2024 total eclipse. The last wave arrived at the end of 2024, leaving us with a mountain of data ready to process.

What happens behind the scenes

Processing was not just opening envelopes. It took custom computer programs written by the ES team to check every recording for a timestamp. If a device malfunctioned or was never set to the right time, we reviewed the Data Collector’s handwritten notes to determine the time and time zone. All times then had to be converted to UTC.

We also had to calculate the exact eclipse times for each site, based on latitude and longitude. Some people entered this information online, others wrote it by hand, and some used formats that did not match the guidance we provided. That meant our team often converted locations by hand, corrected missing negatives in coordinates, and double checked any site that appeared in the middle of the ocean.

To keep participants in the loop, we regularly updated a public “data dashboard” spreadsheet that showed what we had received for each site, including microSD cards, online notes, and written notes. Social media posts pointed people back to this dashboard so they could confirm their information. We also shared maps of sites and a feedback form where participants could flag errors or confirm details. Each case was resolved one by one, with as many fixes made as possible.

In total, five custom programs were developed to handle audio data, mapping, eclipse timing, and other tasks. All of this code, along with full documentation, will be released publicly on GitHub by the end of 2026.

It was a bit like receiving thousands of puzzle pieces from hundreds of different puzzle boxes. Each piece matters, but first we had to sort them into the right box before we could put the bigger picture together.

Why your effort mattered

Even if your recording did not end up in the final published analysis, your participation still mattered. Every card, every note, and every attempt helped us refine the process and build one of the most extensive eclipse sound archives ever created, which is on track to be publicly available by the end of 2026. You helped prove that a project of this scale is possible.

Explore the full journey

Want to see exactly how data moves from envelopes on our desks to public access on Zenodo? Check out the Data Processing Stages section of the Your Data in Action page. There you will find the full flowchart and a plain language explanation of how we move data from collection to discovery.

👉 Your Data in Action: Processing Stages