Once a listening query set starts running, we download and process the corresponding data: (1) the listening mentions themselves and (2) data enrichments (additional information about the mentions for the analysis).
The processing rates for data and data enrichments vary; some data will be processed faster, some slower. It takes time to receive data from the social network itself, and we also process the listening data in batches, not post by post. For this reason, the new information about listening mentions will be continually updated in your feed.
The following table shows what data is available, how often new data is downloaded, and how often existing data is updated:
Downloading and processing Today’s Listening data
The delays in downloading data are apparent in Analytics when you include Today in the selected date range.
Today can be selected as a part of a broader date range and it’s also included in the following date range shortcuts:
- This Week
- This Month
- This Quarter
- This Year
Although listening mentions are available almost immediately (per table above), it may take up to 2 hours to see advanced data such as sentiment, location, language, country, gender, topics, keywords, etc.
If you opt to see only Today’s data, you will be informed in the corresponding widget that there is still data to be loaded.
If you include Today in a more extended date range, there will typically be some data shown, but it may not include all the latest data., We will let you know that data may be missing with an alert icon and explanatory tooltip.
Twitter historical data
Historical data is available for Twitter. Once you create a query set and add Twitter as a data source, you can choose to collect historical data from the last 30, 90 or 365 days.
The data backfill is only available for query sets that start collecting the mentions immediately; it is not available for query sets scheduled for the future.
By the nature of the data, the historical mentions won't appear in the Community module. Since we're talking about the past, such mentions would only make the Community cluttered, and there doesn't seem to be a good use case to show them.
In certain situations, the data backfill process can be paused or canceled: