Automated Emails sometimes missing inventory images

This incident has been resolved. Multiple inventory ingestion passes have completed without the queue falling behind or raising errors anymore.

We have verified the queue has caught up yesterday, and continues to not have issues processing images. We will continue monitoring the next inventory processing cycle to confirm before closing this incident out.

Images should be rendering for all vehicle content in marketing and advertising material.

We are continuing to monitor the image queue as it catches up to real-time ingestion. Given the fact that images are hosted on third-party systems before being downloaded to Orbee's CDN, we need to pull these "politely" with proper timing between requests and have pushed the speed at which images can be processed to close to those third-party systems' limits. Therefore we expect the queue to be fully caught up in the next 24 hours.

We'll provide an update tomorrow regarding the wrap-up of the image queue. Currently, images are already being processed same-day for new vehicles ingested into Orbee's Platform.

We are continuing to monitor the image queue as it gets back to normal. Vehicle images are largely back up and working but we will continue to monitor while new inventory vehicles come through, to make sure the queue maintains its throughput and stays up-to-date.

A hotfix has been implemented in the meantime and we do see images showing up again for many vehicles. We will continue to monitor the situation as the rest of the image processing queue finishes processing.

We have identified that the inventory image download queue is currently lagging. Therefore, this issue only affects vehicles made available in the dealer's inventory feed within the past 72 hours that are already being marketed to customers in automated emails.

We have already increased the amount of processing we support for this queue, and will continue to monitor the situation and identify why the queue fell behind. We'll provide another update on the progress of getting this image download queue back under control.

We are currently investigating an issue experienced by some customers intermittently, where automated emails going out can sometimes be missing vehicle images when referencing their ingested inventory. We will provide an update once a cause for this issue has been identified.