Unusual Web Request Detection via Machine Learning
Elastic's machine learning job identifies rare and unusual URLs accessed through web browsing or network traffic, signaling potential initial access, persistence, command-and-control, or data exfiltration activities that deviate from normal user behavior or legitimate application traffic patterns.
This brief details a machine learning-based detection rule developed by Elastic, designed to identify unusual web requests that could indicate malicious activity. Published on July 28, 2026, the rule leverages analytics on network traffic (Packetbeat) and endpoint data (Elastic Defend) to detect rare and statistically anomalous URLs. This capability is crucial for identifying early stages of compromise, such as initial access via watering hole attacks where trusted websites serve uncommon URLs for payload delivery, or advanced command-and-control (C2) communications by established malware. The detection also covers suspicious scanning, enumeration, or attack traffic directed at local web servers, including activity from bots and web scrapers, by flagging deviations from established web traffic baselines. This helps defenders proactively identify subtle indicators of compromise that might bypass signature-based detections.
Attack Chain
[Attack Chain omitted as the source describes a detection capability for anomalous web activity rather than a specific, multi-step attack campaign.]
Impact
If the detected unusual web requests are indeed malicious, the impact can range from initial system compromise, leading to persistent access for attackers, to the establishment of covert command-and-control channels, and potentially significant data exfiltration. Successful exploitation through such channels could result in loss of sensitive information, disruption of operations, or further propagation of malware within the network. While the rule itself does not describe specific victims or sectors, it aims to prevent these outcomes by flagging the anomalous activity before it escalates into a major incident.
Recommendation
- Enable Elastic Defend integration and the Network Packet Capture integration to provide the necessary data inputs for the
Unusual Web Requestmachine learning job. - Deploy the
packetbeat_rare_urls_eamachine learning job and ensure it is configured and running without errors. - Review the
Unusual Web Requestalert details, focusing on the specific rare URL, associated IP addresses, and user agents to determine legitimacy. - Correlate alerts with other security events and threat intelligence to identify broader attack campaigns or ongoing threats.
- Add identified legitimate rare web activity (e.g., technical support sites, internal web applications with unique transaction URLs) to an exclusion list to reduce false positives as described in the
false_positivessection.