Stories by Net AI on Medium

Decomposition is a novel technology for service-level traffic stream quantification, which complements and enhances current traffic classification solutions that are heavily based on Deep Packet Inspection (DPI).
Examining network traffic through DPI can be expensive, as it requires high-performance computing platforms or dedicated hardware to process individual packets at ever increasing line rates. DPI faces further challenges when confronted to the growing adoption of security and privacy measures such as data traffic encryption techniques (including HTTPS, VPN tunnelling, etc.) that limit ability to directly inspect traffic.
<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kQButgxwEj-p5itfUplBVw.jpeg"></figure>Traffic decomposition leverages cutting-edge machine learning techniques to disentangle the overall traffic volume observed at a given network entity (e.g., NB, MEC facility, etc.) into the underlying service-level demands (e.g., YouTube, Facebook, Google services, etc.). Therefore, decomposition can opportunistically replace the heavy compute load demand of DPI with lightweight inference via a neural network model that only ingests metadata. By summarising aggregate traffic volumes, this approach offers gains of several orders of magnitude in terms of computing resource usage, and substantial reductions of the cost of high-throughput traffic classification.
While decomposition is a data-driven approach that requires traffic classification labels during the learning phase, once trained, it unlocks a range of possibilities that are not available solely through DPI. For instance, decomposition scales with the deployment size and can be applied extensively, owing to its low compute footprint. As a matter of fact, standard DPI and classification solutions typically run at specific points in the network as they are compute-intensive. Instead, and thanks to its lightweight nature, our decomposition technology can be run at a much finer geographic granularity, and possibly operate at the level of individual switches, thus offering enhanced visibility on the network status over existing solutions.
Scalability with growing data rates
State-of-the-art DPI solutions are expected to inspect up to 10Gbps per CPU core. Microscope, our decomposition engine, can process and disaggregate hundreds of Gbps per core, and can scale to even larger volumes with ease. This is because Microscope does not inspect individual (sampled) packets but receives as input time series of the aggregate traffic; also, Microscope produces service-level traffic volumes (aggregated over all flows for each service) directly. Overall, Microscope’s complexity only grows with the number of network elements to be monitored in parallel, and has constant cost (compute, energy) with respect to the volume of traffic generated at each of those elements.
Accuracy
Microscope outputs the current or future (if combined with our dedicated forecasting module) service-level traffic volumes using a neural network, which is an approximation model and thus may entail inherent accuracy limitations. However, evaluations conducted with real- world measurement traffic collected in a metropolitan-scale RAN demonstrate less than 1% Normalised Mean Absolute Error (NMAE) when compared against the ground-truth data provided by the operator and obtained with DPI.
Training
Microscope builds on a data-driven model, hence employs labelled measurements in order to learn to decompose service-level traffic. A relevant performance metric for such type of models is re-training frequency. Experiments with real-world measurement traffic collected in a metropolitan-scale RAN for the most popular 20 services (accounting for over 70% of the total network traffic load) showed that Microscope decomposition results stay accurate for at least 8 weeks, implying very limited re-training frequency and costs.
Summary
<ul>
<li>Extends and complements existing DPI systems, where DPI can be used to provide ongoing training and categorisation, with AI/ML based Microscope providing extensive, wide area bulk data analysis.</li>
<li>Will scale with the exponential growth of data in both wireless and fixed networks with application to broader networks such as SDWAN.</li>
<li>Provides analytics even for encrypted traffic giving valuable insight into all streams without compromising data integrity or security.</li>
<li>Offers real-time operation, low compute overhead, cost effectiveness, extensibility and native cloud-based implementation, which jointly enable widespread deployment of the solution so as to produce live and high-resolution insights into the network behaviour.</li>
</ul>
Case Study
Successive generations of mobile technology continue to add complexity with an increasing number of services competing for resources, including voice over IP and data services ranging from video streaming to social media and real time gaming. Monitoring the resultant torrent of data and identifying services affecting network behaviour is increasingly difficult, time consuming and resource intensive. Network engineers are already overtasked with identifying and resolving problems, and automated solutions are needed to free up these valuable resources for problem correction rather than identification.
Net AI cloud-native analytics solution uses advanced AI/ML, to tame the torrent of data, feeding high level metadata into an AI engine and providing real-time insights on anomalous patterns and other services affecting events. Problems can be rapidly identified and evolving behaviours such as localised video load forecast before they affect performance. Network-wide real-time analytics help engineers prioritise their efforts and bring other tools to further identify and resolve issues without consuming huge amounts of compute resources or dedicated hardware, allowing to and focus engineering time on network performance optimisation.
<img src="https://medium.com/_/stat?event=post.clientViewed&amp;referrerSource=full_rss&amp;postId=465d1c0ef0ad" width="1" height="1" alt="">

Harnessing the power of AI to enhance Deep Packet Inspection capabilities

5G infrastructures will consume significantly more power than the 4G systems they replace. This is in part due to the inexorable growth of user data supported by the much greater capacity available through 5G technologies, but also due to the larger number of base stations deployed to support this capacity. As a result, over 90% of leading mobile network operators have expressed concerns about the rise in energy costs they have to sustain [1].
<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yRIkbHQAf1wyYusyCAOcvA.jpeg"></figure>The Radio Access Network (RAN) part of the 5G infrastructure consumes a significant fraction of this power to generate the radio signals that allow wireless communications with the end user devices. This has traditionally been the case in previous generations of cellular networks [2], but will be exacerbated in the case of 5G systems: for instance, according to recent assessments, energy consumption in the edge of softwarized mobile networks may increase as much as 25% solely due to the impact of active cooling [3], [4], which sums up to the much denser BS and/or Remote Unit (RU) deployment that high-performance but low-range technologies like mmWave require.
Operators are then called to make energy savings a higher priority than in past, in order to both guarantee the sustainability of mobile communication infrastructures and the compliance with green recovery programmes. Indeed, major operators believe that a cultural shift that moves sustainability and energy efficiency at the core of corporate strategy will be one of the top three solutions to drive substantial Operating Expenses (OPEX) in 5G technologies [5]. Achieving such a change requires a more holistic approach to energy-prudent operations that goes beyond current approaches, which often leave power management solutions to individual operating units.
In this context, the predictive automation of user behaviour can significantly reduce the power consumption of 5G RAN both through optimization of the compute resources needed to support data transmission and through intelligent management of the radios, channels and amplifiers at the heart of 5G radio towers. Such an intelligent management of the RAN throttles network capacity based on the fluctuations in the demand and is key in ensuring an optimal balance between the two conflicting goals of energy saving and network quality. According to GSMA, two thirds of operators expect Artificial Intelligence (AI) to drive savings ranging from 10% to more than 30% in the next two years [5].
“Increasing energy efficiency is one of our top company goals, and we focus a lot on this topic. The problem with intelligent management of radio resources (i.e. reducing network capacities during hours of low demand) is maintaining an optimal balance between saving energy and delivering network quality to our customers. We expect the main benefit of Net AI’s ML/AI technology to be automatically providing the optimal balance between these two contradicting goals in real time”.
— Thomas Hodi, AI Product Manager | Senior RAN Expert, A1 Telekom Austria Group
Using its innovative AI driven data analytics, Net AI can predict network usage on an application-by-application basis — allowing operators to attain energy savings in two ways. First, Net AI models can produce optimal periodic (e.g., hourly or daily) configurations of the RAN that can be simply enacted by the operator at the corresponding time, and that potentially abide by the needs of the local user base (e.g., in terms of expected usage of specific classes of mobile services). Second, Net AI develops advanced solutions to forecast demand in real time and support the live optimization of the network performance, via a fully automated configuration of the RAN. These approaches can help reduce the carbon footprint of an ever expanding 5G network while delivering expanded capacity and capability, and contribute to meeting the ambitious targets set by major operators like Verizon, Telefónica or Vodafone, which aim at 50%-70% carbon intensity reduction by 2025–2030.
[1] Mobile Europe, ‘More that 90% of operators concerned about 5G energy costs,’ <a href="https://www.mobileeurope.co.uk/press-wire/more-than-90-of-operators-concerned-about-rising-energy-costs-for-5g-and-edge">https://www.mobileeurope.co.uk/press-wire/more-than-90-of-operators-concerned-about-rising-energy-costs-for-5g-and-edge</a>
[2] J. Wu, Y. Zhang, M. Zukerman, and E. K. Yung, ‘Energy-efficient base- stations sleep- mode techniques in green cellular networks: A survey,’ IEEE Communications Surveys &amp; Tutorials, vol. 17, no. 2, 2015
[3] M. Masoudi et al., ‘Green Mobile Networks for 5G and Beyond,’ IEEE Access, 7, 2019
[4] E. Ahvar, A.-C. Orgerie, and A. Lébre, ‘Estimating Energy Consumption of Cloud, Fog and Edge Computing Infrastructures,’ IEEE Trans. Sustain. Comput., 2019
[5] GSMA, ‘The Mobile Economy,’ 2022.
<img src="https://medium.com/_/stat?event=post.clientViewed&amp;referrerSource=full_rss&amp;postId=dc0ee1640130" width="1" height="1" alt="">

Blog

Harnessing the power of AI to enhance Deep Packet Inspection capabilities

Driving Energy Efficiency in 5G Networks Using AI