The Management Activity API input, configured in the Splunk Add-on for Office 365, is not collecting all logs in real-time from the Office 365 portal.
Other input types, such as Audit logs (using Microsoft Graph API) and Message Trace input, are successfully fetching logs without latency. The issue appears to be specific to the Management Activity API input, while other data sources remain unaffected.
1. Checked the latency in the associated index and the sourcetype with the help of the below SPL to determine the stats of latency.
SPL:
index=<index_name> sourcetype=<sourcetyepe_name> source=<source_name>
| eval diff_in_min= (_indextime - _time)/60
| eval capturetime=strftime(_time,"%Y-%m-%d %H:%M:%S")
| eval indextime=strftime(_indextime,"%Y-%m-%d %H:%M:%S")
| table capturetime indextime diff_in_min
Found that multiple inputs in the Splunk Add-on for Office 365 utilizing Management Activity API had a latency of approximately 3000 minutes.
2. Therefore, checked the internal logs, with the below search query to check if there were any error messages in the _internal logs but found that there were no such logs that could explain about the cause of latency.
SPL:
index="_internal" sourcetype=*o365* datainput="b'<input_name>'" level=ERROR
No Error logs, as mentioned above.
3. Additionally, checked the queue blockages on the instance where the inputs were configured but no queue blockage were found.
SPL:
index="_internal" host=<hostname> blocked=true
No queue blockage was found.
4. Upon reviewing the _internal logs other than the Error logs to check if the input is lagging behind to collect the logs or not, a significant time gap of around 12 hours was found between the _time field (2024-10-31 15:16:06.145) and the start_time (2024-10-31T00:28:21). Both timestamps are in a 24-hour format.
Screenshot:

5. Based on the above, it was found that some part of the latency originates from Splunk’s end, as the input is lagging behind in collecting logs. Further investigation into Microsoft’s Management Activity API documentation revealed that:
Therefore, the remaining latency is due to Microsoft’s data availability rather than an issue within Splunk.
The latency is caused by two main factors:
Microsoft API Delays:
Splunk Processing Latency:
[splunk_ta_o365_management_activity]
interval = 300
disabled = 0
sourcetype = o365:management:activity
number_of_threads = 4
| Revision | Publish Date | Comments |
|---|---|---|
1.0 |
29-Sep-2026
|
Initial Release |